Sep 15 18:38:24 devstack cinder-volume[75150]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 15 18:38:24 devstack cinder-volume[75150]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 15 18:38:24 devstack cinder-volume[75150]: we strongly recommend against using it for new projects. Sep 15 18:38:24 devstack cinder-volume[75150]: If you are already using Eventlet, we recommend migrating to a different Sep 15 18:38:24 devstack cinder-volume[75150]: framework. For more detail see Sep 15 18:38:24 devstack cinder-volume[75150]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 15 18:38:24 devstack cinder-volume[75150]: import eventlet # noqa Sep 15 18:38:27 devstack cinder-volume[75150]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 18:38:27 devstack cinder-volume[75150]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 18:38:27 devstack cinder-volume[75150]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 18:38:28 devstack cinder-volume[75150]: INFO dbcounter [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Registered counter for database cinder Sep 15 18:38:28 devstack cinder-volume[75150]: DEBUG oslo_db.sqlalchemy.engines [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:38:28 devstack cinder-volume[75150]: DEBUG dbcounter [-] [75150] Writer thread running {{(pid=75150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 18:38:28 devstack cinder-volume[75150]: INFO cinder.rpc [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 15 18:38:28 devstack cinder-volume[75150]: INFO cinder.rpc [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 15 18:38:28 devstack cinder-volume[75150]: DEBUG oslo_db.sqlalchemy.engines [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:38:29 devstack cinder-volume[75150]: INFO cinder.volume.manager [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Determined volume DB was empty at startup. Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG cinder.volume.manager [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75150) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 15 18:38:29 devstack cinder-volume[75150]: INFO cinder.volume.manager [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 15 18:38:29 devstack cinder-volume[75150]: WARNING stevedore.named [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 15 18:38:29 devstack cinder-volume[75150]: WARNING castellan.key_manager [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 18:38:29 devstack cinder-volume[75150]: WARNING cinder.keymgr.conf_key_mgr [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG cinder.volume.drivers.lvm [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75150) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_concurrency.processutils [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_concurrency.processutils [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.385s {{(pid=75150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_db.sqlalchemy.engines [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:38:29 devstack cinder-volume[75150]: INFO cinder.rpc [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 15 18:38:29 devstack cinder-volume[75150]: INFO cinder.rpc [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 15 18:38:29 devstack cinder-volume[75150]: WARNING stevedore.named [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 15 18:38:29 devstack cinder-volume[75150]: WARNING castellan.key_manager [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 18:38:29 devstack cinder-volume[75150]: INFO cinder.volume.manager [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_db.sqlalchemy.engines [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:38:29 devstack cinder-volume[75150]: INFO oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Starting 1 workers Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Started child 75297 {{(pid=75150) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Full set of CONF: {{(pid=75150) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] ******************************************************************************** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Configuration options gathered from: {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 15 18:38:29 devstack cinder-volume[75297]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] ================================================================================ {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] allow_availability_zone_fallback = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] allow_compression_on_image_upload = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] allowed_direct_url_schemes = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] api_rate_limit = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] auth_strategy = keystone {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] az_cache_duration = 3600 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_availability_zone = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_host = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_stats_polling_interval = 60 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backup_api_class = cinder.backup.api.API {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backup_name_template = backup-%s {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backup_use_same_host = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backup_use_temp_snapshot = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] chap_password = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] chap_username = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cinder_internal_tenant_project_id = 09079506415f463a960236a3f665f39e {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cinder_internal_tenant_user_id = 55aba4f818b54504a672e999bbc32f1a {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cloned_volume_same_az = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cluster = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] compression_format = gzip {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] config_dir = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] config_source = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] control_exchange = openstack {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] debug = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] default_availability_zone = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] default_group_type = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] default_volume_type = lvmdriver-1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] disk_geometry = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] driver_client_cert = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] driver_client_cert_key = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] driver_data_namespace = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] driver_ssl_cert_path = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] driver_ssl_cert_verify = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] driver_use_ssl = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] enable_force_upload = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] enable_new_services = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] enable_unsupported_driver = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] enforce_multipath_for_image_xfer = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] filter_function = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_api_insecure = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_api_ssl_compression = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_ca_certificates_file = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_certfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75297]: INFO cinder.volume.manager [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_keyfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_num_retries = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance_request_timeout = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] goodness_function = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] graceful_shutdown_timeout = 5 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] group_api_class = cinder.group.api.API {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] host = devstack {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_compress_on_upload = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_conversion_address_space_limit = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_conversion_cpu_limit = 60 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_conversion_disable = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_upload_use_cinder_backend = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_upload_use_internal_tenant = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_volume_cache_enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_volume_cache_max_count = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] init_host_max_objects_retrieval = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] instance_format = [instance: %(uuid)s] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] iscsi_target_flags = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] iscsi_write_cache = on {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] iser_helper = tgtadm {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] iser_ip_address = 192.168.122.20 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] iser_port = 3260 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] log_color = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] log_config_append = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] log_dir = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] log_file = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] log_options = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] log_rotate_interval = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] log_rotate_interval_type = days {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] log_rotation_type = none {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] max_age = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] max_logfile_count = 30 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] max_logfile_size_mb = 200 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] max_over_subscription_ratio = 20.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] message_reap_interval = 86400 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] message_ttl = 2592000 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] monkey_patch = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] monkey_patch_modules = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] my_ip = 192.168.122.20 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] no_snapshot_gb_quota = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] num_iser_scan_tries = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] num_shell_tries = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] num_volume_device_scan_tries = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] nvmeof_conn_info_version = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] nvmet_ns_id = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] nvmet_port_id = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] osapi_max_limit = 1000 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] osapi_volume_ext_list = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] osapi_volume_listen_port = 8776 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] osapi_volume_use_ssl = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] osapi_volume_workers = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] per_volume_size_limit = -1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] periodic_fuzzy_delay = 60 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] periodic_interval = 60 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] public_endpoint = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] publish_errors = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] quota_backup_gigabytes = 1000 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] quota_backups = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] quota_gigabytes = 1000 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] quota_groups = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] quota_snapshots = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] quota_volumes = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] rate_limit_burst = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] rate_limit_except_level = CRITICAL {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] rate_limit_interval = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] reinit_driver_count = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] replication_device = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] report_discard_supported = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] report_interval = 120 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] reservation_clean_interval = 86400 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] reservation_expire = 86400 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] reserved_image_namespaces = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] reserved_percentage = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] rpc_response_timeout = 120 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] run_external_periodic_tasks = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] scst_target_driver = iscsi {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] scst_target_iqn_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_down_time = 720 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] shell_completion = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] snapshot_name_template = snapshot-%s {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] snapshot_same_host = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] split_loggers = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] state_path = /opt/stack/data/cinder {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] storage_availability_zone = nova {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] storage_protocol = iSCSI {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] syslog_log_facility = LOG_USER {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] target_helper = lioadm {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] target_ip_address = 192.168.122.20 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] target_port = 3260 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] target_protocol = iscsi {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] target_secondary_ip_addresses = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] trace_flags = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] transport_url = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] until_refresh = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] use_chap_auth = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] use_default_quota_class = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] use_journal = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] use_json = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] use_multipath_for_image_xfer = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] use_stderr = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] use_syslog = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] verify_glance_signatures = enabled {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_api_class = cinder.volume.api.API {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_backend_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_clear = zero {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_clear_ionice = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_clear_size = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_copy_bps_limit = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_dd_blocksize = 1M {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_name_template = volume-%s {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_service_inithost_offload = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volume_usage_audit_period = month {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] zoning_mode = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.auth_section = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.auth_type = password {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.auth_version = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.cache = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.certfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.insecure = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.interface = public {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.keyfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_password = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcache_username = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.region_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.service_type = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.backend = dogpile.cache.null {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.backend_argument = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.backend_expiration_time = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.config_prefix = cache.oslo {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.debug_cache_backend = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.enable_retry_client = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.enable_socket_keepalive = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.expiration_time = 600 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.memcache_dead_retry = 300 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.memcache_sasl_enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.password = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.proxies = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.redis_db = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.redis_server = localhost:6379 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.retry_attempts = 2 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.retry_delay = 0.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.socket_keepalive_count = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.socket_keepalive_idle = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.socket_keepalive_interval = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.socket_timeout = 1.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.tls_allowed_ciphers = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.tls_cafile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.tls_certfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.tls_enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.tls_keyfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cache.username = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] coordination.backend_url = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.asyncio_connection = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.asyncio_slave_connection = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.backend = sqlalchemy {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.connection = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.connection_debug = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.connection_parameters = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.connection_recycle_time = 3600 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.connection_trace = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.db_inc_retry_interval = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.db_max_retries = 20 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.db_max_retry_interval = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.db_retry_interval = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.max_overflow = 50 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.max_pool_size = 5 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.max_retries = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.pool_timeout = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.retry_interval = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.slave_connection = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.sqlite_synchronous = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.synchronous_reader = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] database.use_db_reconnect = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:29 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_tracing.insecure = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.connection_string = messaging:// {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.es_doc_type = notification {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.es_scroll_size = 10000 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.es_scroll_time = 2m {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.filter_error_trace = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.hmac_keys = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.sentinel_service_name = mymaster {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.socket_timeout = 0.1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.trace_requests = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler.trace_sqlalchemy = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack sudo[75301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 15 18:38:30 devstack sudo[75301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler_jaeger.process_tags = {} {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] profiler_otlp.service_name_prefix = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.policy_default_rule = default {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] privsep_osbrick.group = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] privsep_osbrick.helper_command = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] privsep_osbrick.user = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cinder_sys_admin.group = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cinder_sys_admin.helper_command = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] cinder_sys_admin.user = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.auth_section = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.auth_type = password {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.cafile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.certfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.collect_timing = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.insecure = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.keyfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.send_service_user_token = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.split_loggers = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.timeout = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.tls_ciphers = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] service_user.tls_min_version = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.auth_section = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.auth_type = password {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.certfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.collect_timing = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.insecure = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.keyfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.region_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.split_loggers = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.timeout = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.tls_ciphers = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] glance.tls_min_version = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.backend_availability_zone = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.chap_password = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.chap_username = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.disk_geometry = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.driver_client_cert = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.driver_data_namespace = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.driver_use_ssl = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.extra_capabilities = {} {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.filter_function = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.goodness_function = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.iscsi_target_flags = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.iser_port = 3260 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.lvm_share_target = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.lvm_type = auto {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.replication_device = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.report_discard_supported = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.target_helper = tgtadm {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.target_port = 3260 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.target_protocol = iscsi {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.trace_flags = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.use_chap_auth = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volume_backend_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volume_clear = zero {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_reports.file_event_handler = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_reports.log_dir = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.backend_host = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.chap_password = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.chap_username = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.disk_geometry = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.filter_function = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.goodness_function = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.iser_helper = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.iser_port = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.lvm_type = auto {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.replication_device = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.storage_protocol = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.target_ip_address = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.target_port = 3260 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.trace_flags = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volume_clear = zero {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] lvmdriver-1.volumes_dir = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_notifications.driver = [] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] key_manager.fixed_key = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.barbican_api_version = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.barbican_endpoint = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.barbican_endpoint_type = public {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.barbican_region_name = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.cafile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.certfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.collect_timing = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.insecure = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.keyfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.number_of_retries = 60 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.retry_delay = 1 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.send_service_user_token = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.split_loggers = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.timeout = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.tls_ciphers = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.tls_min_version = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.verify_ssl = True {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican.verify_ssl_path = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.auth_section = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.auth_type = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.cafile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.certfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.collect_timing = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.insecure = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.keyfile = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.split_loggers = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.timeout = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.tls_ciphers = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] barbican_service_user.tls_min_version = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.approle_role_id = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.approle_secret_id = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.auth_method = approle {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.auth_path = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.kv_mountpoint = secret {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.kv_path = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.kv_version = 2 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.namespace = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.root_token_id = **** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.ssl_ca_crt_file = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.timeout = 60.0 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.token_file = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.token_role = None {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.use_ssl = False {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:38:30 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] ******************************************************************************** {{(pid=75150) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 15 18:38:30 devstack sudo[75301]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:30 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:30 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:30 devstack sudo[75464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:38:30 devstack sudo[75464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:30 devstack sudo[75464]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:30 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.270s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:30 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:38:30 devstack cinder-volume[75297]: INFO cinder.brick.local_dev.lvm [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 15 18:38:30 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:30 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:30 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:30 devstack sudo[75555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:38:30 devstack sudo[75555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:31 devstack sudo[75555]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG cinder.brick.local_dev.lvm [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75297) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:31 devstack sudo[75651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:38:31 devstack sudo[75651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:31 devstack sudo[75651]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.540s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:31 devstack sudo[75859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:38:31 devstack sudo[75859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:31 devstack sudo[75859]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.348s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:31 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:31 devstack sudo[75911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 15 18:38:31 devstack sudo[75911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:32 devstack sudo[75911]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:32 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.299s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:32 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:32 devstack sudo[75991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:38:32 devstack sudo[75991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:32 devstack sudo[75991]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:32 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:32 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:32 devstack sudo[75998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:38:32 devstack sudo[75998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:32 devstack sudo[75998]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:32 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:32 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:32 devstack sudo[76026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:38:32 devstack sudo[76026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:33 devstack sudo[76026]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:33 devstack sudo[76090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:38:33 devstack sudo[76090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:33 devstack sudo[76090]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:33 devstack sudo[76095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:38:33 devstack sudo[76095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:33 devstack sudo[76095]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:33 devstack cinder-volume[75297]: INFO cinder.volume.drivers.lvm [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:33 devstack sudo[76099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:38:33 devstack sudo[76099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:33 devstack sudo[76099]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG cinder.volume.drivers.lvm [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Updating volume stats {{(pid=75297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 18:38:33 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:33 devstack sudo[76109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:38:33 devstack sudo[76109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:34 devstack sudo[76109]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:34 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:34 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:34 devstack sudo[76112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:38:34 devstack sudo[76112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:34 devstack sudo[76112]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:34 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:34 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:34 devstack sudo[76115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:38:34 devstack sudo[76115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:34 devstack sudo[76115]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:34 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:34 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:34 devstack sudo[76118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:38:34 devstack sudo[76118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:34 devstack sudo[76118]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:34 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:35 devstack cinder-volume[75297]: INFO cinder.volume.driver [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Driver hasn't implemented _init_vendor_properties() Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG cinder.volume.driver [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75297) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG oslo_db.sqlalchemy.engines [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75297) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG dbcounter [-] [75297] Writer thread running {{(pid=75297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG cinder.db.api [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Building query based on filter {{(pid=75297) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG cinder.image.image_utils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75297) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 15 18:38:35 devstack cinder-volume[75297]: INFO cinder.keymgr.migration [None req-493d5716-9909-4005-864d-6800d18c2833 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG cinder.volume.drivers.lvm [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Updating volume stats {{(pid=75297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:35 devstack sudo[76123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:38:35 devstack sudo[76123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:35 devstack sudo[76123]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:35 devstack sudo[76127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:38:35 devstack sudo[76127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:35 devstack sudo[76127]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:35 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:35 devstack sudo[76130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:38:35 devstack sudo[76130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:36 devstack sudo[76130]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:36 devstack sudo[76133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:38:36 devstack sudo[76133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:36 devstack sudo[76133]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG cinder.manager [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Notifying Schedulers of capabilities ... {{(pid=75297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:38:36 devstack cinder-volume[75297]: INFO cinder.volume.manager [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Driver initialization completed successfully. Sep 15 18:38:36 devstack cinder-volume[75297]: INFO cinder.manager [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Initiating service 2 cleanup Sep 15 18:38:36 devstack cinder-volume[75297]: INFO cinder.manager [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Service 2 cleanup completed. Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG cinder.service [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Creating RPC server for service cinder-volume {{(pid=75297) start /opt/stack/cinder/cinder/service.py:231}} Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG cinder.service [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75297) start /opt/stack/cinder/cinder/service.py:237}} Sep 15 18:38:36 devstack cinder-volume[75297]: INFO cinder.volume.manager [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG cinder.volume.drivers.lvm [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Updating volume stats {{(pid=75297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:36 devstack sudo[76138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:38:36 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:36 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:36 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:36 devstack sudo[76141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:38:36 devstack sudo[76141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:37 devstack sudo[76141]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:37 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:37 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:37 devstack sudo[76144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:38:37 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:37 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:37 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.235s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:37 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:38:37 devstack sudo[76150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:38:37 devstack sudo[76150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:38:37 devstack sudo[76150]: pam_unix(sudo:session): session closed for user root Sep 15 18:38:37 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:38:37 devstack cinder-volume[75297]: INFO cinder.volume.manager [None req-328afa6b-69ef-4e1f-8edd-dc5615fa7518 None None] Driver post RPC initialization completed successfully. Sep 15 18:38:39 devstack cinder-volume[75150]: DEBUG dbcounter [-] [75150] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:38:47 devstack cinder-volume[75297]: DEBUG dbcounter [-] [75297] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:38:47 devstack cinder-volume[75297]: DEBUG dbcounter [-] [75297] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:38:50 devstack cinder-volume[75297]: DEBUG oslo_service.periodic_task [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running periodic task VolumeManager._thread_info {{(pid=75297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:38:50 devstack cinder-volume[75297]: DEBUG cinder.volume.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] thread count: 6 {{(pid=75297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:38:50 devstack cinder-volume[75297]: DEBUG cinder.volume.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] thread info: [<_MainThread(MainThread, started 137050211139712)>, , , , , ] {{(pid=75297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:39:50 devstack cinder-volume[75297]: DEBUG oslo_service.periodic_task [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:39:50 devstack cinder-volume[75297]: DEBUG cinder.volume.drivers.lvm [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Updating volume stats {{(pid=75297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 18:39:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:39:50 devstack sudo[78733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:39:50 devstack sudo[78733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:39:50 devstack sudo[78733]: pam_unix(sudo:session): session closed for user root Sep 15 18:39:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:39:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:39:50 devstack sudo[78760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:39:50 devstack sudo[78760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:39:51 devstack sudo[78760]: pam_unix(sudo:session): session closed for user root Sep 15 18:39:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:39:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:39:51 devstack sudo[78763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:39:51 devstack sudo[78763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:39:51 devstack sudo[78763]: pam_unix(sudo:session): session closed for user root Sep 15 18:39:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:39:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:39:51 devstack sudo[78766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:39:51 devstack sudo[78766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:39:51 devstack sudo[78766]: pam_unix(sudo:session): session closed for user root Sep 15 18:39:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:39:51 devstack cinder-volume[75297]: DEBUG cinder.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Notifying Schedulers of capabilities ... {{(pid=75297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:39:51 devstack cinder-volume[75297]: DEBUG oslo_service.periodic_task [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running periodic task VolumeManager._thread_info {{(pid=75297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:39:51 devstack cinder-volume[75297]: DEBUG cinder.volume.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] thread count: 6 {{(pid=75297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:39:51 devstack cinder-volume[75297]: DEBUG cinder.volume.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] thread info: [<_MainThread(MainThread, started 137050211139712)>, , , , , ] {{(pid=75297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:40:47 devstack cinder-volume[75297]: DEBUG dbcounter [-] [75297] Writing DB stats cinder:SELECT=1 {{(pid=75297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:40:47 devstack cinder-volume[75297]: DEBUG dbcounter [-] [75297] Writing DB stats cinder:UPDATE=1 {{(pid=75297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:40:50 devstack cinder-volume[75297]: DEBUG oslo_service.periodic_task [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:40:50 devstack cinder-volume[75297]: DEBUG cinder.volume.drivers.lvm [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Updating volume stats {{(pid=75297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 18:40:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:40:50 devstack sudo[81767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:40:50 devstack sudo[81767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:40:50 devstack sudo[81767]: pam_unix(sudo:session): session closed for user root Sep 15 18:40:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:40:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:40:50 devstack sudo[81774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:40:50 devstack sudo[81774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:40:51 devstack sudo[81774]: pam_unix(sudo:session): session closed for user root Sep 15 18:40:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:40:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:40:51 devstack sudo[81780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:40:51 devstack sudo[81780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:40:51 devstack sudo[81780]: pam_unix(sudo:session): session closed for user root Sep 15 18:40:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:40:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:40:51 devstack sudo[81783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:40:51 devstack sudo[81783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:40:51 devstack sudo[81783]: pam_unix(sudo:session): session closed for user root Sep 15 18:40:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:40:51 devstack cinder-volume[75297]: DEBUG cinder.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Notifying Schedulers of capabilities ... {{(pid=75297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:40:51 devstack cinder-volume[75297]: DEBUG oslo_service.periodic_task [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running periodic task VolumeManager._thread_info {{(pid=75297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:40:51 devstack cinder-volume[75297]: DEBUG cinder.volume.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] thread count: 6 {{(pid=75297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:40:51 devstack cinder-volume[75297]: DEBUG cinder.volume.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] thread info: [<_MainThread(MainThread, started 137050211139712)>, , , , , ] {{(pid=75297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:41:50 devstack cinder-volume[75297]: DEBUG oslo_service.periodic_task [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:41:50 devstack cinder-volume[75297]: DEBUG cinder.volume.drivers.lvm [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Updating volume stats {{(pid=75297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 18:41:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:41:50 devstack sudo[83974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:41:50 devstack sudo[83974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:41:50 devstack sudo[83974]: pam_unix(sudo:session): session closed for user root Sep 15 18:41:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:41:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:41:50 devstack sudo[83977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:41:50 devstack sudo[83977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:41:51 devstack sudo[83977]: pam_unix(sudo:session): session closed for user root Sep 15 18:41:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:41:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:41:51 devstack sudo[83983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:41:51 devstack sudo[83983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:41:51 devstack sudo[83983]: pam_unix(sudo:session): session closed for user root Sep 15 18:41:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:41:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:41:51 devstack sudo[83986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:41:51 devstack sudo[83986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:41:51 devstack sudo[83986]: pam_unix(sudo:session): session closed for user root Sep 15 18:41:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:41:51 devstack cinder-volume[75297]: DEBUG cinder.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Notifying Schedulers of capabilities ... {{(pid=75297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:42:47 devstack cinder-volume[75297]: DEBUG dbcounter [-] [75297] Writing DB stats cinder:SELECT=1 {{(pid=75297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:42:47 devstack cinder-volume[75297]: DEBUG dbcounter [-] [75297] Writing DB stats cinder:UPDATE=1 {{(pid=75297) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:42:50 devstack cinder-volume[75150]: INFO oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Caught SIGTERM, stopping children Sep 15 18:42:50 devstack cinder-volume[75150]: DEBUG oslo_concurrency.lockutils [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Acquiring lock "singleton_lock" {{(pid=75150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 18:42:50 devstack cinder-volume[75150]: DEBUG oslo_concurrency.lockutils [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Acquired lock "singleton_lock" {{(pid=75150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 18:42:50 devstack cinder-volume[75150]: DEBUG oslo_concurrency.lockutils [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Releasing lock "singleton_lock" {{(pid=75150) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 18:42:50 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Stop services. {{(pid=75150) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 15 18:42:50 devstack cinder-volume[75150]: DEBUG oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Killing children. {{(pid=75150) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 15 18:42:50 devstack cinder-volume[75150]: INFO oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Waiting on 1 children to exit Sep 15 18:42:50 devstack cinder-volume[75297]: DEBUG oslo_service.periodic_task [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:42:50 devstack cinder-volume[75297]: DEBUG cinder.volume.drivers.lvm [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Updating volume stats {{(pid=75297) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 18:42:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:42:50 devstack sudo[85285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 18:42:50 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:42:50 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root Sep 15 18:42:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:42:50 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:42:50 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:42:50 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:42:51 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:42:51 devstack sudo[85291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 18:42:51 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:42:51 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:42:51 devstack sudo[85294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 18:42:51 devstack sudo[85294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:42:51 devstack sudo[85294]: pam_unix(sudo:session): session closed for user root Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.processutils [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG cinder.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Notifying Schedulers of capabilities ... {{(pid=75297) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG oslo_service.periodic_task [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] Running periodic task VolumeManager._thread_info {{(pid=75297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG cinder.volume.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] thread count: 5 {{(pid=75297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG cinder.volume.manager [None req-6751b42c-a10d-46fd-adfe-f23bf4dee40f None None] thread info: [<_MainThread(MainThread, started 137050211139712)>, , , , ] {{(pid=75297) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.lockutils [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Acquiring lock "singleton_lock" {{(pid=75297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.lockutils [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Acquired lock "singleton_lock" {{(pid=75297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 18:42:51 devstack cinder-volume[75297]: DEBUG oslo_concurrency.lockutils [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Releasing lock "singleton_lock" {{(pid=75297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 18:42:51 devstack cinder-volume[75297]: WARNING amqp [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 15 18:42:51 devstack cinder-volume[75297]: WARNING amqp [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 15 18:42:51 devstack cinder-volume[75150]: INFO oslo_service.backend._eventlet.service [None req-fbc99617-0801-4f03-8f02-cbccb039e5b7 None None] Child 75297 exited with status 0 Sep 15 18:42:51 devstack cinder-volume[85298]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 15 18:42:51 devstack cinder-volume[85298]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 15 18:42:51 devstack cinder-volume[85298]: we strongly recommend against using it for new projects. Sep 15 18:42:51 devstack cinder-volume[85298]: If you are already using Eventlet, we recommend migrating to a different Sep 15 18:42:51 devstack cinder-volume[85298]: framework. For more detail see Sep 15 18:42:51 devstack cinder-volume[85298]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 15 18:42:51 devstack cinder-volume[85298]: import eventlet # noqa Sep 15 18:42:53 devstack cinder-volume[85298]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 18:42:53 devstack cinder-volume[85298]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 18:42:53 devstack cinder-volume[85298]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 18:42:54 devstack cinder-volume[85298]: INFO dbcounter [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Registered counter for database cinder Sep 15 18:42:54 devstack cinder-volume[85298]: DEBUG oslo_db.sqlalchemy.engines [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG dbcounter [-] [85298] Writer thread running {{(pid=85298) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 18:42:55 devstack cinder-volume[85298]: INFO cinder.rpc [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 15 18:42:55 devstack cinder-volume[85298]: INFO cinder.rpc [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_db.sqlalchemy.engines [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:42:55 devstack cinder-volume[85298]: INFO cinder.volume.manager [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Determined volume DB was empty at startup. Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG cinder.volume.manager [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85298) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 15 18:42:55 devstack cinder-volume[85298]: INFO cinder.volume.manager [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 15 18:42:55 devstack cinder-volume[85298]: WARNING stevedore.named [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 15 18:42:55 devstack cinder-volume[85298]: WARNING castellan.key_manager [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 18:42:55 devstack cinder-volume[85298]: WARNING cinder.keymgr.conf_key_mgr [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 18:42:55 devstack cinder-volume[85298]: INFO cinder.volume.manager [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_db.sqlalchemy.engines [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85298) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:42:55 devstack cinder-volume[85298]: INFO oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Starting 1 workers Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Started child 85516 {{(pid=85298) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Full set of CONF: {{(pid=85298) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] ******************************************************************************** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Configuration options gathered from: {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] ================================================================================ {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] allow_availability_zone_fallback = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] allow_compression_on_image_upload = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] allowed_direct_url_schemes = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] api_rate_limit = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] auth_strategy = keystone {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_availability_zone = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_host = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_stats_polling_interval = 60 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backup_api_class = cinder.backup.api.API {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backup_name_template = backup-%s {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backup_use_same_host = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backup_use_temp_snapshot = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] chap_password = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] chap_username = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cinder_internal_tenant_project_id = 09079506415f463a960236a3f665f39e {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cinder_internal_tenant_user_id = 55aba4f818b54504a672e999bbc32f1a {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85516]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cluster = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] compression_format = gzip {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] compute_api_class = cinder.compute.nova.API {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] config_dir = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] config_source = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] control_exchange = openstack {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] debug = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] default_availability_zone = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] default_group_type = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] default_volume_type = QuobyteHD {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] disk_geometry = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] driver_client_cert = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] driver_client_cert_key = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] driver_data_namespace = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] driver_ssl_cert_path = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] driver_ssl_cert_verify = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] driver_use_ssl = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] enable_new_services = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] enable_unsupported_driver = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] enabled_backends = ['QuobyteHD'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] enforce_multipath_for_image_xfer = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] filter_function = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_api_insecure = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_api_ssl_compression = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_ca_certificates_file = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_catalog_info = image:glance:publicURL {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_certfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_keyfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_num_retries = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance_request_timeout = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] goodness_function = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] graceful_shutdown_timeout = 5 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] group_api_class = cinder.group.api.API {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] host = devstack {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_compress_on_upload = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_conversion_address_space_limit = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_conversion_cpu_limit = 60 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_conversion_disable = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_upload_use_cinder_backend = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_upload_use_internal_tenant = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_volume_cache_enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_volume_cache_max_count = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] image_volume_cache_max_size_gb = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] init_host_max_objects_retrieval = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] instance_format = [instance: %(uuid)s] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] iscsi_target_flags = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] iscsi_write_cache = on {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] iser_helper = tgtadm {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] iser_ip_address = 192.168.122.20 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] iser_port = 3260 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] log_color = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] log_config_append = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] log_dir = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] log_file = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] log_options = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] log_rotate_interval = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] log_rotate_interval_type = days {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] log_rotation_type = none {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] max_age = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] max_logfile_count = 30 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] max_logfile_size_mb = 200 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] max_over_subscription_ratio = 20.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] message_reap_interval = 86400 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] message_ttl = 2592000 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] migration_create_volume_timeout_secs = 300 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] monkey_patch = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] monkey_patch_modules = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] my_ip = 192.168.122.20 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] no_snapshot_gb_quota = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] num_iser_scan_tries = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] num_shell_tries = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] num_volume_device_scan_tries = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] nvmeof_conn_info_version = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] nvmet_ns_id = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] nvmet_port_id = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] osapi_max_limit = 1000 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] osapi_volume_ext_list = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] osapi_volume_listen_port = 8776 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] osapi_volume_use_ssl = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] osapi_volume_workers = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] per_volume_size_limit = -1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] periodic_fuzzy_delay = 60 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] periodic_interval = 60 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] public_endpoint = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] publish_errors = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] quota_backup_gigabytes = 1000 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] quota_backups = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] quota_gigabytes = 1000 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] quota_groups = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] quota_snapshots = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] quota_volumes = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] rate_limit_burst = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] rate_limit_except_level = CRITICAL {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] rate_limit_interval = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] reinit_driver_count = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] replication_device = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] report_discard_supported = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] report_interval = 120 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] reservation_clean_interval = 86400 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] reservation_expire = 86400 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] reserved_image_namespaces = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] reserved_percentage = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] rpc_response_timeout = 120 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] run_external_periodic_tasks = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] scst_target_driver = iscsi {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] scst_target_iqn_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_down_time = 720 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] shell_completion = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] snapshot_name_template = snapshot-%s {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] split_loggers = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] state_path = /opt/stack/data/cinder {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] storage_availability_zone = nova {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] storage_protocol = iSCSI {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] syslog_log_facility = LOG_USER {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] target_helper = lioadm {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] target_ip_address = 192.168.122.20 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] target_port = 3260 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] target_protocol = iscsi {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] target_secondary_ip_addresses = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] trace_flags = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] transport_url = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] until_refresh = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] use_chap_auth = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] use_default_quota_class = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] use_journal = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] use_json = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] use_multipath_for_image_xfer = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] use_stderr = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] use_syslog = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] verify_glance_signatures = enabled {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_api_class = cinder.volume.api.API {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_backend_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_clear = zero {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_clear_ionice = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_clear_size = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_copy_bps_limit = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_dd_blocksize = 1M {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_name_template = volume-%s {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_service_inithost_offload = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volume_usage_audit_period = month {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] zoning_mode = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_concurrency.disable_process_locking = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.auth_section = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.auth_type = password {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.auth_version = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.cache = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.certfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.include_service_catalog = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85516]: INFO cinder.volume.manager [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.insecure = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.remotefs [None req-367251db-ff70-48ec-892a-c6be9381447c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85516) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.interface = public {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.keyfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_password = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcache_username = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.region_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.service_type = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.backend = dogpile.cache.null {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.backend_argument = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.backend_expiration_time = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.config_prefix = cache.oslo {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.debug_cache_backend = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.enable_retry_client = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.enable_socket_keepalive = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.expiration_time = 600 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.hashclient_retry_attempts = 2 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.memcache_dead_retry = 300 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.memcache_pool_maxsize = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.memcache_sasl_enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.password = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.proxies = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.redis_db = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.redis_server = localhost:6379 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.retry_attempts = 2 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.retry_delay = 0.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.socket_keepalive_count = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.socket_keepalive_idle = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.socket_keepalive_interval = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.socket_timeout = 1.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.tls_allowed_ciphers = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.tls_cafile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.tls_certfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.tls_enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.tls_keyfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cache.username = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] coordination.backend_url = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.asyncio_connection = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.asyncio_slave_connection = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.backend = sqlalchemy {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.connection = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.connection_debug = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.connection_parameters = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.connection_recycle_time = 3600 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.connection_trace = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.db_inc_retry_interval = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.db_max_retries = 20 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.db_max_retry_interval = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.db_retry_interval = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.max_overflow = 50 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.max_pool_size = 5 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.max_retries = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.mysql_wsrep_sync_wait = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.pool_timeout = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.retry_interval = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.slave_connection = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.sqlite_synchronous = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.synchronous_reader = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] database.use_db_reconnect = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_tracing.insecure = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.connection_string = messaging:// {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.es_doc_type = notification {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.es_scroll_size = 10000 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.es_scroll_time = 2m {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.filter_error_trace = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.hmac_keys = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.sentinel_service_name = mymaster {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.socket_timeout = 0.1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.trace_requests = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler.trace_sqlalchemy = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler_jaeger.process_tags = {} {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler_jaeger.service_name_prefix = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] profiler_otlp.service_name_prefix = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.enforce_new_defaults = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.policy_default_rule = default {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.policy_file = policy.yaml {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] privsep_osbrick.group = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] privsep_osbrick.helper_command = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] privsep_osbrick.user = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cinder_sys_admin.group = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cinder_sys_admin.helper_command = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] cinder_sys_admin.user = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.auth_section = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.auth_type = password {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.cafile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.certfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.collect_timing = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.insecure = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.keyfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.send_service_user_token = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.split_loggers = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.timeout = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.tls_ciphers = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] service_user.tls_min_version = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.auth_section = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.auth_type = password {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.certfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.collect_timing = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.insecure = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.keyfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.region_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.split_loggers = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.timeout = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.tls_ciphers = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] glance.tls_min_version = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.backend_availability_zone = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.chap_password = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.chap_username = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.disk_geometry = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.driver_client_cert = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.driver_client_cert_key = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.driver_data_namespace = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.driver_use_ssl = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.extra_capabilities = {} {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.filter_function = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.goodness_function = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.iscsi_target_flags = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.iscsi_write_cache = on {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.iser_helper = tgtadm {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.iser_port = 3260 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_host = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_login = admin {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_mount_options = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_password = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_private_key = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_share_path = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.num_shell_tries = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.quobyte_volume_url = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.replication_device = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.report_discard_supported = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.reserved_percentage = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.target_helper = tgtadm {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.target_port = 3260 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.target_protocol = iscsi {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.trace_flags = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.unique_fqdn_network = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.use_chap_auth = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.volume_backend_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.volume_clear = zero {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.volume_clear_ionice = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.volume_clear_size = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_reports.file_event_handler = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_reports.log_dir = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.backend_availability_zone = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.backend_host = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.chap_password = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.chap_username = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.chiscsi_conf = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.disk_geometry = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.driver_client_cert = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.driver_data_namespace = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.driver_use_ssl = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.extra_capabilities = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.filter_function = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.goodness_function = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.iser_helper = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.iser_ip_address = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.iser_port = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.iser_target_prefix = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_host = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_login = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_mount_options = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_password = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_private_key = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_share_path = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_ssh_port = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.num_shell_tries = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.nvmet_port_id = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.replication_device = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.report_discard_supported = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.reserved_percentage = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.scst_target_driver = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.storage_protocol = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.target_helper = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.target_ip_address = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.target_port = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.target_prefix = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.target_protocol = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.trace_flags = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.use_chap_auth = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.volume_clear = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.volume_clear_size = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] QuobyteHD.volumes_dir = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.ssl = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_notifications.driver = [] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_notifications.retry = -1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] key_manager.fixed_key = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.barbican_api_version = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.barbican_endpoint = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.barbican_endpoint_type = public {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.barbican_region_name = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.cafile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.certfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.collect_timing = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.insecure = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.keyfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.number_of_retries = 60 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.retry_delay = 1 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.send_service_user_token = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.split_loggers = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.timeout = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.tls_ciphers = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.tls_min_version = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.verify_ssl = True {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican.verify_ssl_path = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.auth_section = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.auth_type = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.cafile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.certfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.collect_timing = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.insecure = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.keyfile = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.split_loggers = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.timeout = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.tls_ciphers = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] barbican_service_user.tls_min_version = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.approle_role_id = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.approle_secret_id = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.auth_method = approle {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.auth_path = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.kv_mountpoint = secret {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.kv_path = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.kv_version = 2 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.namespace = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.root_token_id = **** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.ssl_ca_crt_file = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.timeout = 60.0 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.token_file = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.token_role = None {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.use_ssl = False {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:42:55 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] ******************************************************************************** {{(pid=85298) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 15 18:42:55 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85516) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 15 18:42:55 devstack cinder-volume[85516]: WARNING cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 15 18:42:55 devstack cinder-volume[85516]: WARNING cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 15 18:42:55 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Running cmd (subprocess): mount.quobyte {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:42:55 devstack quobyte-client[85519]: Reading configuration file: /etc/quobyte/client.cfg Sep 15 18:42:55 devstack quobyte-client[85519]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 15 18:42:55 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:42:55 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:42:55 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:42:55 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=85516) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:42:55 devstack cinder-volume[85516]: INFO cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b ... Sep 15 18:42:55 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 -c /etc/quobyte/client-cinder.cfg {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:42:55 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 -c /etc/quobyte/client-cinder.cfg Sep 15 18:42:55 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:42:56 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.374s {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:42:56 devstack cinder-volume[85516]: INFO cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b succeeded Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=85516) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.383s {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:42:56 devstack sudo[85621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:42:56 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:42:56 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.225s {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:42:56 devstack cinder-volume[85516]: INFO cinder.volume.driver [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Driver hasn't implemented _init_vendor_properties() Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.volume.driver [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9375953674316, 'free_capacity_gb': 1775.9375953674316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85516) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_db.sqlalchemy.engines [None req-367251db-ff70-48ec-892a-c6be9381447c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85516) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG dbcounter [-] [85516] Writer thread running {{(pid=85516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.db.api [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Building query based on filter {{(pid=85516) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.image.image_utils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85516) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 15 18:42:56 devstack cinder-volume[85516]: INFO cinder.keymgr.migration [None req-45975abe-4038-4559-97fc-76431e069622 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=85516) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=85516) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:42:56 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:42:56 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:42:56 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.217s {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.manager [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Notifying Schedulers of capabilities ... {{(pid=85516) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:42:56 devstack cinder-volume[85516]: INFO cinder.volume.manager [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Driver initialization completed successfully. Sep 15 18:42:56 devstack cinder-volume[85516]: INFO cinder.manager [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Initiating service 3 cleanup Sep 15 18:42:56 devstack cinder-volume[85516]: INFO cinder.manager [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Service 3 cleanup completed. Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.service [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Creating RPC server for service cinder-volume {{(pid=85516) start /opt/stack/cinder/cinder/service.py:231}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.service [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85516) start /opt/stack/cinder/cinder/service.py:237}} Sep 15 18:42:56 devstack cinder-volume[85516]: INFO cinder.volume.manager [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=85516) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.quobyte [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=85516) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:42:56 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:42:56 devstack sudo[85628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:42:56 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:42:57 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root Sep 15 18:42:57 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-367251db-ff70-48ec-892a-c6be9381447c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.264s {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:42:57 devstack cinder-volume[85516]: INFO cinder.volume.manager [None req-367251db-ff70-48ec-892a-c6be9381447c None None] Driver post RPC initialization completed successfully. Sep 15 18:43:01 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-74ed6f07-5ec7-4607-b61c-04cfbaac8ebc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:43:01 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-74ed6f07-5ec7-4607-b61c-04cfbaac8ebc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:43:01 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.quobyte [None req-74ed6f07-5ec7-4607-b61c-04cfbaac8ebc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=85516) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:43:01 devstack cinder-volume[85516]: DEBUG cinder.volume.drivers.quobyte [None req-74ed6f07-5ec7-4607-b61c-04cfbaac8ebc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=85516) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:43:01 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-74ed6f07-5ec7-4607-b61c-04cfbaac8ebc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85516) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:43:01 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-74ed6f07-5ec7-4607-b61c-04cfbaac8ebc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:43:01 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:43:01 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:43:01 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Sep 15 18:43:01 devstack cinder-volume[85516]: DEBUG oslo_concurrency.processutils [None req-74ed6f07-5ec7-4607-b61c-04cfbaac8ebc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.235s {{(pid=85516) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:43:01 devstack cinder-volume[85516]: DEBUG cinder.manager [None req-74ed6f07-5ec7-4607-b61c-04cfbaac8ebc None None] Notifying Schedulers of capabilities ... {{(pid=85516) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:43:05 devstack cinder-volume[85298]: INFO oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Caught SIGTERM, stopping children Sep 15 18:43:05 devstack cinder-volume[85298]: DEBUG oslo_concurrency.lockutils [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Acquiring lock "singleton_lock" {{(pid=85298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 18:43:05 devstack cinder-volume[85298]: DEBUG oslo_concurrency.lockutils [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Acquired lock "singleton_lock" {{(pid=85298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 18:43:05 devstack cinder-volume[85298]: DEBUG oslo_concurrency.lockutils [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Releasing lock "singleton_lock" {{(pid=85298) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 18:43:05 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Stop services. {{(pid=85298) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 15 18:43:05 devstack cinder-volume[85298]: DEBUG oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Killing children. {{(pid=85298) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 15 18:43:05 devstack cinder-volume[85298]: INFO oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Waiting on 1 children to exit Sep 15 18:43:07 devstack cinder-volume[85516]: DEBUG dbcounter [-] [85516] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=85516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:43:07 devstack cinder-volume[85516]: DEBUG dbcounter [-] [85516] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=85516) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:43:10 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Acquiring lock "singleton_lock" {{(pid=85516) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 18:43:10 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Acquired lock "singleton_lock" {{(pid=85516) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 18:43:10 devstack cinder-volume[85516]: DEBUG oslo_concurrency.lockutils [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Releasing lock "singleton_lock" {{(pid=85516) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 18:43:10 devstack cinder-volume[85516]: WARNING amqp [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 15 18:43:10 devstack cinder-volume[85516]: WARNING amqp [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 15 18:43:10 devstack cinder-volume[85298]: INFO oslo_service.backend._eventlet.service [None req-9a21dc3d-613f-4092-8d30-873440a688e9 None None] Child 85516 exited with status 0 Sep 15 18:43:10 devstack cinder-volume[85842]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 15 18:43:10 devstack cinder-volume[85842]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 15 18:43:10 devstack cinder-volume[85842]: we strongly recommend against using it for new projects. Sep 15 18:43:10 devstack cinder-volume[85842]: If you are already using Eventlet, we recommend migrating to a different Sep 15 18:43:10 devstack cinder-volume[85842]: framework. For more detail see Sep 15 18:43:10 devstack cinder-volume[85842]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 15 18:43:10 devstack cinder-volume[85842]: import eventlet # noqa Sep 15 18:43:13 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85842) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 18:43:13 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85842) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 18:43:13 devstack cinder-volume[85842]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85842) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 18:43:13 devstack cinder-volume[85842]: INFO dbcounter [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Registered counter for database cinder Sep 15 18:43:13 devstack cinder-volume[85842]: DEBUG oslo_db.sqlalchemy.engines [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85842) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG dbcounter [-] [85842] Writer thread running {{(pid=85842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 18:43:14 devstack cinder-volume[85842]: INFO cinder.rpc [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 15 18:43:14 devstack cinder-volume[85842]: INFO cinder.rpc [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_db.sqlalchemy.engines [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85842) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:43:14 devstack cinder-volume[85842]: INFO cinder.volume.manager [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Determined volume DB was empty at startup. Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG cinder.volume.manager [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85842) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 15 18:43:14 devstack cinder-volume[85842]: WARNING stevedore.named [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 15 18:43:14 devstack cinder-volume[85842]: WARNING castellan.key_manager [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 18:43:14 devstack cinder-volume[85842]: WARNING cinder.keymgr.conf_key_mgr [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 18:43:14 devstack cinder-volume[85842]: INFO cinder.volume.manager [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_db.sqlalchemy.engines [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85842) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:43:14 devstack cinder-volume[85842]: INFO oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Starting 1 workers Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Started child 86137 {{(pid=85842) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Full set of CONF: {{(pid=85842) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] ******************************************************************************** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] Configuration options gathered from: {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] ================================================================================ {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] allow_availability_zone_fallback = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] allow_compression_on_image_upload = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] allowed_direct_url_schemes = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[86137]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] api_rate_limit = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] auth_strategy = keystone {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_availability_zone = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_host = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_stats_polling_interval = 60 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backup_api_class = cinder.backup.api.API {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backup_name_template = backup-%s {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backup_use_same_host = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backup_use_temp_snapshot = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] chap_password = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] chap_username = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cinder_internal_tenant_project_id = 09079506415f463a960236a3f665f39e {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cinder_internal_tenant_user_id = 55aba4f818b54504a672e999bbc32f1a {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cluster = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] compression_format = gzip {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] compute_api_class = cinder.compute.nova.API {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] config_dir = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] config_source = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] control_exchange = openstack {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] debug = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] default_availability_zone = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] default_group_type = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] default_volume_type = QuobyteHD {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] disk_geometry = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] driver_client_cert = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] driver_client_cert_key = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] driver_data_namespace = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] driver_ssl_cert_path = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] driver_ssl_cert_verify = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] driver_use_ssl = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] enable_new_services = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] enable_unsupported_driver = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] enabled_backends = ['QuobyteHD'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] enforce_multipath_for_image_xfer = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] filter_function = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_api_insecure = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_api_ssl_compression = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_ca_certificates_file = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_catalog_info = image:glance:publicURL {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_certfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_keyfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_num_retries = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance_request_timeout = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] goodness_function = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] graceful_shutdown_timeout = 5 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] group_api_class = cinder.group.api.API {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] host = devstack {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_compress_on_upload = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_conversion_address_space_limit = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_conversion_cpu_limit = 60 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_conversion_disable = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_upload_use_cinder_backend = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_upload_use_internal_tenant = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_volume_cache_enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_volume_cache_max_count = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] image_volume_cache_max_size_gb = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] init_host_max_objects_retrieval = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] instance_format = [instance: %(uuid)s] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] iscsi_target_flags = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] iscsi_write_cache = on {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] iser_helper = tgtadm {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] iser_ip_address = 192.168.122.20 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] iser_port = 3260 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] log_color = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] log_config_append = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] log_dir = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] log_file = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] log_options = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] log_rotate_interval = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] log_rotate_interval_type = days {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] log_rotation_type = none {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] max_age = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] max_logfile_count = 30 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] max_logfile_size_mb = 200 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] max_over_subscription_ratio = 20.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] message_reap_interval = 86400 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] message_ttl = 2592000 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] migration_create_volume_timeout_secs = 300 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] monkey_patch = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] monkey_patch_modules = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] my_ip = 192.168.122.20 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] no_snapshot_gb_quota = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] num_iser_scan_tries = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] num_shell_tries = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86137) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] num_volume_device_scan_tries = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] nvmeof_conn_info_version = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] nvmet_ns_id = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] nvmet_port_id = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] osapi_max_limit = 1000 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] osapi_volume_ext_list = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] osapi_volume_listen_port = 8776 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] osapi_volume_use_ssl = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] osapi_volume_workers = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] per_volume_size_limit = -1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] periodic_fuzzy_delay = 60 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] periodic_interval = 60 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] public_endpoint = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] publish_errors = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] quota_backup_gigabytes = 1000 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] quota_backups = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] quota_gigabytes = 1000 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] quota_groups = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] quota_snapshots = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] quota_volumes = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] rate_limit_burst = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] rate_limit_except_level = CRITICAL {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] rate_limit_interval = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] reinit_driver_count = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] replication_device = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] report_discard_supported = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] report_interval = 120 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] reservation_clean_interval = 86400 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] reservation_expire = 86400 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] reserved_image_namespaces = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] reserved_percentage = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] rpc_response_timeout = 120 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] run_external_periodic_tasks = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] scst_target_driver = iscsi {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] scst_target_iqn_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_down_time = 720 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] shell_completion = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] snapshot_name_template = snapshot-%s {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] split_loggers = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] state_path = /opt/stack/data/cinder {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] storage_availability_zone = nova {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] storage_protocol = iSCSI {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] syslog_log_facility = LOG_USER {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] target_helper = lioadm {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] target_ip_address = 192.168.122.20 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] target_port = 3260 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] target_protocol = iscsi {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] target_secondary_ip_addresses = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] trace_flags = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] transport_url = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] until_refresh = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] use_chap_auth = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] use_default_quota_class = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] use_journal = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] use_json = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] use_multipath_for_image_xfer = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] use_stderr = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] use_syslog = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] verify_glance_signatures = enabled {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_api_class = cinder.volume.api.API {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_backend_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_clear = zero {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_clear_ionice = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_clear_size = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_copy_bps_limit = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_dd_blocksize = 1M {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_name_template = volume-%s {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_service_inithost_offload = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volume_usage_audit_period = month {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] zoning_mode = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_concurrency.disable_process_locking = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.auth_section = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.auth_type = password {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.auth_version = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.cache = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.certfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.include_service_catalog = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.insecure = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.interface = public {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.keyfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_password = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcache_username = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86137) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.region_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.service_type = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.quobyte [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.quobyte [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.backend = dogpile.cache.null {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.backend_argument = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.backend_expiration_time = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.config_prefix = cache.oslo {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Running cmd (subprocess): mount.quobyte {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.debug_cache_backend = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.enable_retry_client = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.enable_socket_keepalive = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.expiration_time = 600 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.hashclient_retry_attempts = 2 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.memcache_dead_retry = 300 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.memcache_pool_maxsize = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.memcache_sasl_enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.password = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.proxies = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.redis_db = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.redis_server = localhost:6379 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.retry_attempts = 2 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.retry_delay = 0.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.socket_keepalive_count = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.socket_keepalive_idle = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.socket_keepalive_interval = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.socket_timeout = 1.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.tls_allowed_ciphers = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.tls_cafile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.tls_certfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.tls_enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.tls_keyfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cache.username = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] coordination.backend_url = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.asyncio_connection = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.asyncio_slave_connection = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.backend = sqlalchemy {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.connection = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.connection_debug = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.connection_parameters = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.connection_recycle_time = 3600 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.connection_trace = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.db_inc_retry_interval = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.db_max_retries = 20 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.db_max_retry_interval = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.db_retry_interval = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.max_overflow = 50 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.max_pool_size = 5 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.max_retries = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.mysql_wsrep_sync_wait = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.pool_timeout = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.retry_interval = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.slave_connection = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.sqlite_synchronous = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.synchronous_reader = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] database.use_db_reconnect = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_tracing.insecure = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.connection_string = messaging:// {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.es_doc_type = notification {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.es_scroll_size = 10000 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.es_scroll_time = 2m {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.filter_error_trace = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.hmac_keys = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.sentinel_service_name = mymaster {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.socket_timeout = 0.1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.trace_requests = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler.trace_sqlalchemy = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler_jaeger.process_tags = {} {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler_jaeger.service_name_prefix = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] profiler_otlp.service_name_prefix = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.enforce_new_defaults = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.policy_default_rule = default {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.policy_file = policy.yaml {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] privsep_osbrick.group = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] privsep_osbrick.helper_command = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] privsep_osbrick.user = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cinder_sys_admin.group = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cinder_sys_admin.helper_command = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] cinder_sys_admin.user = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.auth_section = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.auth_type = password {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.cafile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.certfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.collect_timing = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.insecure = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.keyfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.send_service_user_token = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.split_loggers = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.timeout = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.tls_ciphers = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] service_user.tls_min_version = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.auth_section = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.auth_type = password {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.certfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.collect_timing = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.insecure = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.keyfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.region_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.split_loggers = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.timeout = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.tls_ciphers = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] glance.tls_min_version = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.backend_availability_zone = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.chap_password = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.chap_username = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.disk_geometry = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.driver_client_cert = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.driver_client_cert_key = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.driver_data_namespace = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.driver_use_ssl = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.extra_capabilities = {} {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.filter_function = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.goodness_function = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.iscsi_target_flags = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.iscsi_write_cache = on {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.iser_helper = tgtadm {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.iser_port = 3260 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_host = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_login = admin {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_mount_options = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_password = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_private_key = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_share_path = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.num_shell_tries = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.quobyte_volume_url = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.replication_device = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.report_discard_supported = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.reserved_percentage = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.target_helper = tgtadm {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.target_port = 3260 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.target_protocol = iscsi {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.trace_flags = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.unique_fqdn_network = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.use_chap_auth = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.volume_backend_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.volume_clear = zero {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.volume_clear_ionice = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.volume_clear_size = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_reports.file_event_handler = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_reports.log_dir = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.backend_availability_zone = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.backend_host = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.chap_password = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.chap_username = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.chiscsi_conf = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.disk_geometry = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.driver_client_cert = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.driver_data_namespace = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.driver_use_ssl = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.extra_capabilities = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.filter_function = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.goodness_function = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.iser_helper = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.iser_ip_address = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.iser_port = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.iser_target_prefix = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_host = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_login = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_mount_options = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_password = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_private_key = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_share_path = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_ssh_port = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.num_shell_tries = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.nvmet_port_id = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.replication_device = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.report_discard_supported = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.reserved_percentage = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.scst_target_driver = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.storage_protocol = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.target_helper = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.target_ip_address = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.target_port = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.target_prefix = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.target_protocol = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.trace_flags = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.use_chap_auth = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.volume_clear = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.volume_clear_size = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] QuobyteHD.volumes_dir = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.ssl = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_notifications.driver = [] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_notifications.retry = -1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] key_manager.fixed_key = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.barbican_api_version = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.barbican_endpoint = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.barbican_endpoint_type = public {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.barbican_region_name = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.cafile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.certfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.collect_timing = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.insecure = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.keyfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.number_of_retries = 60 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.retry_delay = 1 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.send_service_user_token = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.split_loggers = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.timeout = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.tls_ciphers = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.tls_min_version = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.verify_ssl = True {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican.verify_ssl_path = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.auth_section = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.auth_type = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.cafile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.certfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.collect_timing = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.insecure = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.keyfile = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.split_loggers = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.timeout = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.tls_ciphers = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] barbican_service_user.tls_min_version = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.approle_role_id = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.approle_secret_id = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.auth_method = approle {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.auth_path = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.kv_mountpoint = secret {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.kv_path = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.kv_version = 2 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.namespace = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.root_token_id = **** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.ssl_ca_crt_file = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.timeout = 60.0 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.token_file = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.token_role = None {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.use_ssl = False {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 18:43:14 devstack cinder-volume[85842]: DEBUG oslo_service.backend._eventlet.service [None req-aebec715-1b94-4ed7-83f5-33100e97cd74 None None] ******************************************************************************** {{(pid=85842) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 15 18:43:14 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.289s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:43:14 devstack cinder-volume[86137]: INFO cinder.volume.driver [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Driver hasn't implemented _init_vendor_properties() Sep 15 18:43:14 devstack cinder-volume[86137]: DEBUG cinder.volume.driver [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9375953674316, 'free_capacity_gb': 1775.9375953674316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86137) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_db.sqlalchemy.engines [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writer thread running {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG cinder.db.api [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Building query based on filter {{(pid=86137) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86137) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:43:15 devstack cinder-volume[86137]: INFO cinder.keymgr.migration [None req-caba8bcf-2405-46f4-a6af-8f3e437abd43 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 15 18:43:15 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:43:15 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:43:15 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.251s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:43:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Driver initialization completed successfully. Sep 15 18:43:15 devstack cinder-volume[86137]: INFO cinder.manager [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Initiating service 3 cleanup Sep 15 18:43:15 devstack cinder-volume[86137]: INFO cinder.manager [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Service 3 cleanup completed. Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG cinder.service [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Creating RPC server for service cinder-volume {{(pid=86137) start /opt/stack/cinder/cinder/service.py:231}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG cinder.service [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86137) start /opt/stack/cinder/cinder/service.py:237}} Sep 15 18:43:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:43:15 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:43:15 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:43:15 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Sep 15 18:43:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.228s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:43:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-83855632-4168-48c6-8361-ad8af47fee88 None None] Driver post RPC initialization completed successfully. Sep 15 18:43:24 devstack cinder-volume[85842]: DEBUG dbcounter [-] [85842] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:43:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:43:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:43:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:43:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 6 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:43:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Flow 'volume_create_manager' (a45a54b6-5c5f-4d7a-8756-1c2d67efe6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73abf367-a645-4d96-b537-950c05cf3e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73abf367-a645-4d96-b537-950c05cf3e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1451904945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb713c84-765b-406f-895a-2f93cdeeb728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb058fd61d148f4a5d43e9bc528aa1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:44:14Z,use_quota=True,user_id='72493eb226c24c24a83a4a51a9120f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d036298c-1bd2-4587-a515-bc6ab8dc8dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d036298c-1bd2-4587-a515-bc6ab8dc8dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a05b0-00ac-4206-b2df-af7490197137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a05b0-00ac-4206-b2df-af7490197137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb713c84-765b-406f-895a-2f93cdeeb728', 'volume_name': 'volume-cb713c84-765b-406f-895a-2f93cdeeb728', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a69decf-b137-445a-8337-d07373055a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a69decf-b137-445a-8337-d07373055a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8367f5d0-f7dc-4494-815e-ebd279c8ec87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:14 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Volume cb713c84-765b-406f-895a-2f93cdeeb728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb713c84-765b-406f-895a-2f93cdeeb728', 'volume_size': 1} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1451904945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb713c84-765b-406f-895a-2f93cdeeb728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb058fd61d148f4a5d43e9bc528aa1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:44:14Z,use_quota=True,user_id='72493eb226c24c24a83a4a51a9120f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Creating volume cb713c84-765b-406f-895a-2f93cdeeb728 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:44:14 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:44:14 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728 1073741824 Sep 15 18:44:14 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:14 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728 1073741824" returned: 0 in 0.685s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:44:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:44:14 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728 Sep 15 18:44:14 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:15 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Sep 15 18:44:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728" returned: 0 in 0.327s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:44:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:44:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:44:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8367f5d0-f7dc-4494-815e-ebd279c8ec87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb713c84-765b-406f-895a-2f93cdeeb728', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2be02e-858a-4f86-b3ac-d61aabb14327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:15 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Volume volume-cb713c84-765b-406f-895a-2f93cdeeb728 (cb713c84-765b-406f-895a-2f93cdeeb728): created successfully Sep 15 18:44:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2be02e-858a-4f86-b3ac-d61aabb14327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Flow 'volume_create_manager' (a45a54b6-5c5f-4d7a-8756-1c2d67efe6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:44:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b3009d78-df21-4280-8383-428c0337a147 tempest-TaggedAttachmentsTest-1669816179 None] Created volume successfully. Sep 15 18:44:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:44:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:44:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:44:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:44:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:44:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:44:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:44:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:44:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:44:45 devstack sudo[87343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:44:45 devstack sudo[87343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:46 devstack sudo[87343]: pam_unix(sudo:session): session closed for user root Sep 15 18:44:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.741s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:44:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:44:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:44:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 6 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:44:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Flow 'volume_create_manager' (68a94a70-eaf6-486a-9d54-3a38d900d611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b78463d-5018-49f1-8835-e1fd887b66c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b78463d-5018-49f1-8835-e1fd887b66c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1008414207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03723c92-2430-4d44-8c70-61b238b4f7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12eeeb13fc3c44b1b6f3292f8f9c0504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:44:51Z,use_quota=True,user_id='840eb5fa69ca4782987d0dc080c4bf9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87b17c2-2d3b-42fe-8fe8-756f092f4d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87b17c2-2d3b-42fe-8fe8-756f092f4d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d318d3-4a7d-4ef6-bfc9-21a4fe6c0114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37d318d3-4a7d-4ef6-bfc9-21a4fe6c0114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03723c92-2430-4d44-8c70-61b238b4f7c1', 'volume_name': 'volume-03723c92-2430-4d44-8c70-61b238b4f7c1', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd711a5e-3e79-4cd5-bd35-1117fd78412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd711a5e-3e79-4cd5-bd35-1117fd78412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77a4f72-b946-458e-b4fd-05830f6e9f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:50 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Volume 03723c92-2430-4d44-8c70-61b238b4f7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03723c92-2430-4d44-8c70-61b238b4f7c1', 'volume_size': 1} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1008414207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03723c92-2430-4d44-8c70-61b238b4f7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12eeeb13fc3c44b1b6f3292f8f9c0504',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:44:51Z,use_quota=True,user_id='840eb5fa69ca4782987d0dc080c4bf9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Creating volume 03723c92-2430-4d44-8c70-61b238b4f7c1 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:44:50 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:44:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:44:50 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1 1073741824 Sep 15 18:44:50 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:51 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Sep 15 18:44:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1 1073741824" returned: 0 in 0.811s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:44:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:44:51 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1 Sep 15 18:44:51 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:52 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Sep 15 18:44:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1" returned: 0 in 0.691s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:44:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:44:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:44:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a77a4f72-b946-458e-b4fd-05830f6e9f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03723c92-2430-4d44-8c70-61b238b4f7c1', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbc3ba7-f200-40a3-89dc-d35ec2ae1e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:52 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Volume volume-03723c92-2430-4d44-8c70-61b238b4f7c1 (03723c92-2430-4d44-8c70-61b238b4f7c1): created successfully Sep 15 18:44:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbc3ba7-f200-40a3-89dc-d35ec2ae1e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Flow 'volume_create_manager' (68a94a70-eaf6-486a-9d54-3a38d900d611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:44:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-118f089c-4ea8-4565-81b6-a2571491cf39 tempest-VolumesAdminNegativeTest-229116871 None] Created volume successfully. Sep 15 18:44:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Acquiring lock "cinder-03723c92-2430-4d44-8c70-61b238b4f7c1-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:44:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Lock "cinder-03723c92-2430-4d44-8c70-61b238b4f7c1-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:44:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Acquiring lock "cinder-quobyte-03723c92-2430-4d44-8c70-61b238b4f7c1" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:44:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Lock "cinder-quobyte-03723c92-2430-4d44-8c70-61b238b4f7c1" acquired by "delete_volume" :: waited 0.045s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:44:54 devstack cinder-volume[86137]: INFO oslo.privsep.daemon [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptkz5cfgm/privsep.sock'] Sep 15 18:44:54 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptkz5cfgm/privsep.sock Sep 15 18:44:54 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:55 devstack cinder-volume[86137]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 15 18:44:55 devstack cinder-volume[86137]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 15 18:44:55 devstack cinder-volume[86137]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 15 18:44:55 devstack cinder-volume[86137]: WARNING oslo.privsep.daemon [-] privsep log: Sep 15 18:44:55 devstack cinder-volume[86137]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 15 18:44:55 devstack cinder-volume[86137]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 15 18:44:55 devstack cinder-volume[86137]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 15 18:44:55 devstack cinder-volume[86137]: WARNING oslo.privsep.daemon [-] privsep log: Sep 15 18:44:55 devstack cinder-volume[86137]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 15 18:44:56 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Sep 15 18:44:56 devstack cinder-volume[86137]: INFO oslo.privsep.daemon [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Spawned new privsep daemon via rootwrap Sep 15 18:44:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Accepted privsep connection to /tmp/tmptkz5cfgm/privsep.sock {{(pid=86137) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 15 18:44:56 devstack cinder-volume[86137]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 15 18:44:56 devstack cinder-volume[86137]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 15 18:44:56 devstack cinder-volume[86137]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 15 18:44:56 devstack cinder-volume[86137]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87425 Sep 15 18:44:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af2f8c3-5b35-4087-be58-86d1e0cf52ed]: (2,) {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:44:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[714fa005-089e-494c-828f-a65845edb5de]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:44:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:44:56 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1 Sep 15 18:44:56 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:57 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Sep 15 18:44:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1" returned: 0 in 0.925s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:44:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:44:57 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1 Sep 15 18:44:57 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:58 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-03723c92-2430-4d44-8c70-61b238b4f7c1" returned: 0 in 0.583s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Lock "cinder-quobyte-03723c92-2430-4d44-8c70-61b238b4f7c1" released by "delete_volume" :: held 3.942s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:44:58 devstack cinder-volume[86137]: WARNING cinder.quota [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:44:58 devstack cinder-volume[86137]: WARNING cinder.quota [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Created reservations ['e7d0164b-5901-45c0-b715-0f5606e71c09', 'aeb18a9a-1b8d-4da0-9212-cd51794679fb', '7d442e73-dd30-43f6-99cd-60c23f094343', '7b977fea-8235-4651-adef-c59bf8ff3bfb'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Flow 'volume_create_manager' (54bb3b15-d49d-4166-84ff-e801a96cd687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e640b0-eb22-40aa-b6a6-c343ab3e48fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e640b0-eb22-40aa-b6a6-c343ab3e48fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1993163234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a660ebcd-7017-41b1-b54a-f081bd59743f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc2fe91241f4593aa538eb7e0362211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:44:58Z,use_quota=True,user_id='51b01056af494cdb828be64b95e91e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da181c94-5fa9-4209-8099-95d7fd106412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da181c94-5fa9-4209-8099-95d7fd106412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da516cfa-9bdd-434a-b7c9-e0b5edce1e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da516cfa-9bdd-434a-b7c9-e0b5edce1e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a660ebcd-7017-41b1-b54a-f081bd59743f', 'volume_name': 'volume-a660ebcd-7017-41b1-b54a-f081bd59743f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4b4544-9837-4c98-8e16-6699212a4f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4b4544-9837-4c98-8e16-6699212a4f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc9f7d5-3b47-463e-aea6-452d72b188f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:44:58 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Volume a660ebcd-7017-41b1-b54a-f081bd59743f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a660ebcd-7017-41b1-b54a-f081bd59743f', 'volume_size': 1} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1993163234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a660ebcd-7017-41b1-b54a-f081bd59743f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cc2fe91241f4593aa538eb7e0362211',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:44:58Z,use_quota=True,user_id='51b01056af494cdb828be64b95e91e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Creating volume a660ebcd-7017-41b1-b54a-f081bd59743f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:44:58 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:44:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:44:58 devstack sudo[87441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f 1073741824 Sep 15 18:44:58 devstack sudo[87441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:44:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:44:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:44:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:44:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:44:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:44:59 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:44:59 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:44:59 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Sep 15 18:44:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.689s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:44:59 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:44:59 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Deleted volume successfully. Sep 15 18:44:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a4a89824-ccd6-45e7-9b7d-4bebf52aa452 tempest-VolumesAdminNegativeTest-229116871 None] Lock "cinder-03723c92-2430-4d44-8c70-61b238b4f7c1-delete_volume" released by "delete_volume" :: held 5.956s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:45:00 devstack sudo[87441]: pam_unix(sudo:session): session closed for user root Sep 15 18:45:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f 1073741824" returned: 0 in 1.264s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:45:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:45:00 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f Sep 15 18:45:00 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:45:00 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Sep 15 18:45:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f" returned: 0 in 0.321s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:45:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:45:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:45:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc9f7d5-3b47-463e-aea6-452d72b188f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a660ebcd-7017-41b1-b54a-f081bd59743f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:45:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7944b3-0894-462d-909b-2395af572072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:45:00 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Volume volume-a660ebcd-7017-41b1-b54a-f081bd59743f (a660ebcd-7017-41b1-b54a-f081bd59743f): created successfully Sep 15 18:45:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7944b3-0894-462d-909b-2395af572072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:45:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Flow 'volume_create_manager' (54bb3b15-d49d-4166-84ff-e801a96cd687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:45:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-2bb80417-514e-400a-abd2-1d9b72d22fd0 tempest-ServerRescueNegativeTestJSON-75557166 None] Created volume successfully. Sep 15 18:45:10 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=8,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:45:10 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=12,cinder:SELECT=10,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:45:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:45:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Acquiring lock "cinder-a660ebcd-7017-41b1-b54a-f081bd59743f-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:45:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "cinder-a660ebcd-7017-41b1-b54a-f081bd59743f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:45:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Acquiring lock "cinder-quobyte-a660ebcd-7017-41b1-b54a-f081bd59743f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:45:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "cinder-quobyte-a660ebcd-7017-41b1-b54a-f081bd59743f" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:45:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[76582b7b-a72c-402f-bc1b-5e122838ecc8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:45:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:45:26 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f Sep 15 18:45:26 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:45:26 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Sep 15 18:45:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f" returned: 0 in 0.394s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:45:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:45:26 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f Sep 15 18:45:26 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:45:27 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Sep 15 18:45:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a660ebcd-7017-41b1-b54a-f081bd59743f" returned: 0 in 0.558s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:45:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "cinder-quobyte-a660ebcd-7017-41b1-b54a-f081bd59743f" released by "delete_volume" :: held 1.047s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:45:27 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Created reservations ['7cd62fed-3cea-4704-b451-53a388319291', '6545dbcc-c5e5-49af-bca9-3ee8551b2aea', 'fafa1c44-7032-4fdc-8d32-b0d283dc3913', '448c365d-487e-4991-a7fd-d043f7d40c76'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:45:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:45:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:45:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:45:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:45:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:45:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:45:27 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:45:27 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:45:28 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Sep 15 18:45:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.439s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:45:28 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:45:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Deleted volume successfully. Sep 15 18:45:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225bec45-2d85-4f84-b44e-f3c8d1a53862 tempest-ServerRescueNegativeTestJSON-75557166 None] Lock "cinder-a660ebcd-7017-41b1-b54a-f081bd59743f-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:45:37 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:INSERT=3 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:45:38 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:45:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:45:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:45:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:45:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:45:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:45:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:45:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:45:45 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:45:45 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:45:46 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Sep 15 18:45:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.793s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:45:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:45:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:45:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 8 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:45:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:45:55 devstack cinder-volume[86137]: WARNING py.warnings [req-01c603a5-b88b-4e9f-99ac-21994f1931f2 req-8f467e6a-5849-4668-8c11-fd9fde1d9d53 tempest-TaggedAttachmentsTest-1669816179 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 15 18:45:55 devstack cinder-volume[86137]: .first() Sep 15 18:45:55 devstack cinder-volume[86137]: Sep 15 18:45:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-01c603a5-b88b-4e9f-99ac-21994f1931f2 req-8f467e6a-5849-4668-8c11-fd9fde1d9d53 tempest-TaggedAttachmentsTest-1669816179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:45:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-01c603a5-b88b-4e9f-99ac-21994f1931f2 req-8f467e6a-5849-4668-8c11-fd9fde1d9d53 tempest-TaggedAttachmentsTest-1669816179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:45:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-01c603a5-b88b-4e9f-99ac-21994f1931f2 req-8f467e6a-5849-4668-8c11-fd9fde1d9d53 tempest-TaggedAttachmentsTest-1669816179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:45:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-01c603a5-b88b-4e9f-99ac-21994f1931f2 req-8f467e6a-5849-4668-8c11-fd9fde1d9d53 tempest-TaggedAttachmentsTest-1669816179 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-cb713c84-765b-406f-895a-2f93cdeeb728', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56e2b74f-03eb-4dc7-9ab2-45805f0e1e5e', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:45:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-01c603a5-b88b-4e9f-99ac-21994f1931f2 req-8f467e6a-5849-4668-8c11-fd9fde1d9d53 tempest-TaggedAttachmentsTest-1669816179 None] attachment_update completed successfully. Sep 15 18:46:01 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-0d4fcab0-0e53-4d08-ad11-ecffca0cf85e req-afbbe103-bbe9-48e9-a4cd-5fbb0d6ec7f2 tempest-TaggedAttachmentsTest-1669816179 None] Terminate volume connection completed successfully. Sep 15 18:46:01 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-0d4fcab0-0e53-4d08-ad11-ecffca0cf85e req-afbbe103-bbe9-48e9-a4cd-5fbb0d6ec7f2 tempest-TaggedAttachmentsTest-1669816179 None] Deleting attachment 56e2b74f-03eb-4dc7-9ab2-45805f0e1e5e. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Flow 'volume_create_manager' (bb64982c-89de-4b63-960f-313b5d1e04c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dedff0-5005-42f4-9e29-96346f486e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dedff0-5005-42f4-9e29-96346f486e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1378555962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532f8fe4-8294-4bdc-9cc4-d85a351855c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8a2d78aaec45fa94f33c5e48b8df78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:46:07Z,use_quota=True,user_id='59bfa08455f6425c91d0a5a674088cd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81156d8c-7ab3-425d-9dac-31f49b480df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81156d8c-7ab3-425d-9dac-31f49b480df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d9d1f5-2413-463b-8cc2-8518d3e9d46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d9d1f5-2413-463b-8cc2-8518d3e9d46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532f8fe4-8294-4bdc-9cc4-d85a351855c6', 'volume_name': 'volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c9164b-a713-4351-abed-eddada453a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c9164b-a713-4351-abed-eddada453a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3336f1-fd06-4e2e-a7f0-d02b621fb8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Volume 532f8fe4-8294-4bdc-9cc4-d85a351855c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6', 'volume_size': 1} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1378555962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532f8fe4-8294-4bdc-9cc4-d85a351855c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f8a2d78aaec45fa94f33c5e48b8df78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:46:07Z,use_quota=True,user_id='59bfa08455f6425c91d0a5a674088cd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Creating volume 532f8fe4-8294-4bdc-9cc4-d85a351855c6 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:46:07 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:07 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 1073741824 Sep 15 18:46:07 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:07 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 1073741824" returned: 0 in 0.576s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:07 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 Sep 15 18:46:07 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:08 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6" returned: 0 in 0.414s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:46:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3336f1-fd06-4e2e-a7f0-d02b621fb8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070836a6-9335-4cde-9d72-ee1019b681b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:08 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Volume volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 (532f8fe4-8294-4bdc-9cc4-d85a351855c6): created successfully Sep 15 18:46:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070836a6-9335-4cde-9d72-ee1019b681b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Flow 'volume_create_manager' (bb64982c-89de-4b63-960f-313b5d1e04c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:46:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ef410923-62c3-48f9-8294-b9d59e4c9d70 tempest-DeleteServersTestJSON-1765778184 None] Created volume successfully. Sep 15 18:46:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-eedebc35-19bd-4de3-b356-d50acb81ac2c req-3338af16-cf4e-4e48-989c-a4ec5f82c9a2 tempest-DeleteServersTestJSON-1765778184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-eedebc35-19bd-4de3-b356-d50acb81ac2c req-3338af16-cf4e-4e48-989c-a4ec5f82c9a2 tempest-DeleteServersTestJSON-1765778184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-eedebc35-19bd-4de3-b356-d50acb81ac2c req-3338af16-cf4e-4e48-989c-a4ec5f82c9a2 tempest-DeleteServersTestJSON-1765778184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-eedebc35-19bd-4de3-b356-d50acb81ac2c req-3338af16-cf4e-4e48-989c-a4ec5f82c9a2 tempest-DeleteServersTestJSON-1765778184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ccc7e013-98e9-4429-971a-f82cc8a1dcd1', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:46:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-eedebc35-19bd-4de3-b356-d50acb81ac2c req-3338af16-cf4e-4e48-989c-a4ec5f82c9a2 tempest-DeleteServersTestJSON-1765778184 None] attachment_update completed successfully. Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Flow 'volume_create_manager' (b8d2f25f-3e7a-4fdc-a1f0-f088f738e4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a1bbf3-7b03-471f-9eff-e0751b753869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a1bbf3-7b03-471f-9eff-e0751b753869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1708290508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6fbc4c9-86ce-4173-b84e-9f6edccc4e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181727b6a1dd43daba93b54ce4e2b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:46:14Z,use_quota=True,user_id='ab0b0652d1ca4753a70caa70b3212e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fac1886-1f66-4bbf-939f-04e11f305ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fac1886-1f66-4bbf-939f-04e11f305ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36023bf3-e544-45b3-9cb6-083b9af82636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36023bf3-e544-45b3-9cb6-083b9af82636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6fbc4c9-86ce-4173-b84e-9f6edccc4e45', 'volume_name': 'volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c690de32-0513-4708-ae4c-aea108de1904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c690de32-0513-4708-ae4c-aea108de1904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5280cbc9-6728-42b0-82ec-0d546fa0c84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:14 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Volume e6fbc4c9-86ce-4173-b84e-9f6edccc4e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45', 'volume_size': 1} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1708290508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6fbc4c9-86ce-4173-b84e-9f6edccc4e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181727b6a1dd43daba93b54ce4e2b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:46:14Z,use_quota=True,user_id='ab0b0652d1ca4753a70caa70b3212e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Creating volume e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:46:14 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:46:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:14 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 1073741824 Sep 15 18:46:14 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:15 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 1073741824" returned: 0 in 0.904s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:15 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 Sep 15 18:46:15 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:15 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45" returned: 0 in 0.518s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:46:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5280cbc9-6728-42b0-82ec-0d546fa0c84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc584d5-6f3c-4580-b27f-efa936a74af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:15 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Volume volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 (e6fbc4c9-86ce-4173-b84e-9f6edccc4e45): created successfully Sep 15 18:46:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc584d5-6f3c-4580-b27f-efa936a74af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Flow 'volume_create_manager' (b8d2f25f-3e7a-4fdc-a1f0-f088f738e4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:46:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bceedf6a-5efb-410d-831b-de7dedd74c30 tempest-ServerActionsTestOtherA-211200806 None] Created volume successfully. Sep 15 18:46:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Acquiring lock "cinder-cb713c84-765b-406f-895a-2f93cdeeb728-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:46:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Lock "cinder-cb713c84-765b-406f-895a-2f93cdeeb728-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:46:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Acquiring lock "cinder-quobyte-cb713c84-765b-406f-895a-2f93cdeeb728" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:46:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Lock "cinder-quobyte-cb713c84-765b-406f-895a-2f93cdeeb728" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:46:18 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3818d36c-90eb-4431-8fc6-f0b644856918]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:46:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:18 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728 Sep 15 18:46:18 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:18 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-b1a51ed2-8b46-4f48-9ac1-ea7dd6c307ad req-fcbac1b6-e068-440d-bbfd-c1b314e99d8e tempest-DeleteServersTestJSON-1765778184 None] Terminate volume connection completed successfully. Sep 15 18:46:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-b1a51ed2-8b46-4f48-9ac1-ea7dd6c307ad req-fcbac1b6-e068-440d-bbfd-c1b314e99d8e tempest-DeleteServersTestJSON-1765778184 None] Deleting attachment ccc7e013-98e9-4429-971a-f82cc8a1dcd1. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:46:18 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728" returned: 0 in 0.503s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:18 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728 Sep 15 18:46:18 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:19 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cb713c84-765b-406f-895a-2f93cdeeb728" returned: 0 in 0.686s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Lock "cinder-quobyte-cb713c84-765b-406f-895a-2f93cdeeb728" released by "delete_volume" :: held 1.258s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Created reservations ['7b42df39-61f0-4f89-9d49-8a854ceda437', 'a98d64aa-7fc7-49b8-8ee8-84fbb4ab780e', 'ce0d196a-d3b4-4ce3-b487-312c0bc4d78f', 'b928e718-b619-4e8b-8e00-bbd7cecfcc84'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:19 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:46:19 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:19 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.309s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:46:19 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Deleted volume successfully. Sep 15 18:46:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-49b6b653-9a4b-4074-a957-112e1ffad595 tempest-TaggedAttachmentsTest-1669816179 None] Lock "cinder-cb713c84-765b-406f-895a-2f93cdeeb728-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:46:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Acquiring lock "cinder-532f8fe4-8294-4bdc-9cc4-d85a351855c6-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:46:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Lock "cinder-532f8fe4-8294-4bdc-9cc4-d85a351855c6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:46:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Acquiring lock "cinder-quobyte-532f8fe4-8294-4bdc-9cc4-d85a351855c6" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:46:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Lock "cinder-quobyte-532f8fe4-8294-4bdc-9cc4-d85a351855c6" acquired by "delete_volume" :: waited 0.038s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:46:21 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dffcad1-306f-4017-b9a3-3471b11dbab0]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:46:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:22 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 Sep 15 18:46:22 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:22 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6" returned: 0 in 0.620s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:22 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6 Sep 15 18:46:22 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:22 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-532f8fe4-8294-4bdc-9cc4-d85a351855c6" returned: 0 in 0.522s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Lock "cinder-quobyte-532f8fe4-8294-4bdc-9cc4-d85a351855c6" released by "delete_volume" :: held 1.240s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Created reservations ['02c5c758-86d1-40e4-b650-cb1ec6193322', '7313e5cf-a9f4-47cc-83bb-1696cd8048e9', '2950cf99-5efc-4a34-94dc-de6c00461de4', '6ca4bf8b-ad38-42dd-b47c-3214be18e2f8'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:23 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:46:23 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:23 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.285s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:46:23 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Deleted volume successfully. Sep 15 18:46:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4e5b444e-3760-4492-a380-a0b4a304e434 tempest-DeleteServersTestJSON-1765778184 None] Lock "cinder-532f8fe4-8294-4bdc-9cc4-d85a351855c6-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:46:33 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=34,cinder:UPDATE=22,cinder:INSERT=4 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:46:33 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Flow 'volume_create_manager' (b1d68374-62a2-4632-b60d-2db4a7640289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785df95d-06c0-4cc5-8844-c6483b8196e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (785df95d-06c0-4cc5-8844-c6483b8196e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1381797689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02730d73-d56d-4832-826d-7be08423f7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1469c5e4f3604546bac961dd9a474ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:46:41Z,use_quota=True,user_id='7efc3d234a2c41c3887b0d1433e66ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890673fc-c27e-4901-b1eb-b12101213479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (890673fc-c27e-4901-b1eb-b12101213479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68671097-4481-4e3d-a628-7e5bead8dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68671097-4481-4e3d-a628-7e5bead8dc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02730d73-d56d-4832-826d-7be08423f7c6', 'volume_name': 'volume-02730d73-d56d-4832-826d-7be08423f7c6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25ea7c9-aa99-4df0-8139-3308f8e64f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25ea7c9-aa99-4df0-8139-3308f8e64f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff17312-d879-4eaf-924e-80771f4fb915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:41 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Volume 02730d73-d56d-4832-826d-7be08423f7c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02730d73-d56d-4832-826d-7be08423f7c6', 'volume_size': 1} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1381797689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02730d73-d56d-4832-826d-7be08423f7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1469c5e4f3604546bac961dd9a474ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:46:41Z,use_quota=True,user_id='7efc3d234a2c41c3887b0d1433e66ce7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Creating volume 02730d73-d56d-4832-826d-7be08423f7c6 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:46:41 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:41 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 1073741824 Sep 15 18:46:41 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:41 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 1073741824" returned: 0 in 0.517s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:41 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 Sep 15 18:46:41 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:42 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6" returned: 0 in 0.330s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:46:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ff17312-d879-4eaf-924e-80771f4fb915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02730d73-d56d-4832-826d-7be08423f7c6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f836fbce-580d-4449-bd5c-e27e4a37f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:42 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Volume volume-02730d73-d56d-4832-826d-7be08423f7c6 (02730d73-d56d-4832-826d-7be08423f7c6): created successfully Sep 15 18:46:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f836fbce-580d-4449-bd5c-e27e4a37f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Flow 'volume_create_manager' (b1d68374-62a2-4632-b60d-2db4a7640289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:46:42 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-84da1a19-15c3-46c9-8930-8fba6da22a65 req-4555527c-96df-4bad-b1ac-a137cd067059 tempest-VolumesSnapshotsTestJSON-255293038 None] Created volume successfully. Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Creating offline snapshot 7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e of volume 02730d73-d56d-4832-826d-7be08423f7c6 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c746184-43d6-43b2-89d4-e045125d906a]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:43 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 Sep 15 18:46:43 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Flow 'volume_create_manager' (7f389987-3f22-41d9-8c00-f2c565dd150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5904aea9-14f2-410a-b4e7-37920b128d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5904aea9-14f2-410a-b4e7-37920b128d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1164012369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1036d21-c08e-4b2b-8ade-2de291b3e165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10942aaf4db4f039fc28b99ba231caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:46:43Z,use_quota=True,user_id='71b3d05c5c15488c9d6a9d7c788135cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a7345d-433e-468c-a9a8-e856c8eb4947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a7345d-433e-468c-a9a8-e856c8eb4947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8bddcc-c0f2-473e-9914-bf5cd0c194ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8bddcc-c0f2-473e-9914-bf5cd0c194ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1036d21-c08e-4b2b-8ade-2de291b3e165', 'volume_name': 'volume-f1036d21-c08e-4b2b-8ade-2de291b3e165', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b6476f-d4ec-40d5-a8da-749942c9e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b6476f-d4ec-40d5-a8da-749942c9e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816dde0f-ee7e-43e2-a736-0ccff293f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:43 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Volume f1036d21-c08e-4b2b-8ade-2de291b3e165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1036d21-c08e-4b2b-8ade-2de291b3e165', 'volume_size': 1} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:43 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6" returned: 0 in 0.595s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:43 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e 1G Sep 15 18:46:43 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:44 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e 1G" returned: 0 in 0.477s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02730d73-d56d-4832-826d-7be08423f7c6 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:44 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02730d73-d56d-4832-826d-7be08423f7c6 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e Sep 15 18:46:44 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:44 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02730d73-d56d-4832-826d-7be08423f7c6 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e" returned: 0 in 0.360s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:44 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e is being set with open permissions: ugo+rw Sep 15 18:46:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:44 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e Sep 15 18:46:44 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:44 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e" returned: 0 in 0.252s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:44 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.info Sep 15 18:46:44 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:45 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.info" returned: 0 in 0.315s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:45 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.info is being set with open permissions: ugo+rw Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:45 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.info Sep 15 18:46:45 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:45 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.info" returned: 0 in 0.375s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.058s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1164012369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1036d21-c08e-4b2b-8ade-2de291b3e165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10942aaf4db4f039fc28b99ba231caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:46:43Z,use_quota=True,user_id='71b3d05c5c15488c9d6a9d7c788135cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Creating volume f1036d21-c08e-4b2b-8ade-2de291b3e165 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:46:45 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:45 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 1073741824 Sep 15 18:46:45 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:45 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-34484137-ce92-4536-8043-a10b33af4956 req-272f354e-6424-4e66-9a86-bf183b1a5714 tempest-VolumesSnapshotsTestJSON-255293038 None] Create snapshot completed successfully Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:45 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:46:45 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:46 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.437s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:46:46 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 1073741824" returned: 0 in 0.707s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:46 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 Sep 15 18:46:46 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:46 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165" returned: 0 in 0.277s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816dde0f-ee7e-43e2-a736-0ccff293f453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1036d21-c08e-4b2b-8ade-2de291b3e165', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a152cf0-5bfe-4945-973f-03c7e1640a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:46:46 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Volume volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 (f1036d21-c08e-4b2b-8ade-2de291b3e165): created successfully Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a152cf0-5bfe-4945-973f-03c7e1640a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Flow 'volume_create_manager' (7f389987-3f22-41d9-8c00-f2c565dd150c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:46:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c5a0f382-2634-449f-8f8b-b68e04484aba tempest-AttachVolumeTestJSON-1572753679 None] Created volume successfully. Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Acquiring lock "cinder-7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Acquiring lock "cinder-quobyte-02730d73-d56d-4832-826d-7be08423f7c6" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-quobyte-02730d73-d56d-4832-826d-7be08423f7c6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Acquiring lock "cinder-quobyte-7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-quobyte-7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Deleting offline snapshot 7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e of volume 02730d73-d56d-4832-826d-7be08423f7c6 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:46:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] snapshot_file for this snap is: volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:46:47 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c23b51-e601-41c0-af17-3cb96dd9bd42]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:46:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:47 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e Sep 15 18:46:47 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:47 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e" returned: 0 in 0.368s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02730d73-d56d-4832-826d-7be08423f7c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:46:47 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d4fb9d-9937-42e3-b278-ec2903981d41]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:46:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:47 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 Sep 15 18:46:47 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:47 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6" returned: 0 in 0.421s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:47 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e Sep 15 18:46:47 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:48 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e" returned: 0 in 0.498s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:48 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e Sep 15 18:46:48 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d27fb08f-c10f-4f49-a7e1-1e0efd7a1c91 req-61e1d824-d072-423e-b06e-e393b7d5e32e tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d27fb08f-c10f-4f49-a7e1-1e0efd7a1c91 req-61e1d824-d072-423e-b06e-e393b7d5e32e tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d27fb08f-c10f-4f49-a7e1-1e0efd7a1c91 req-61e1d824-d072-423e-b06e-e393b7d5e32e tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-d27fb08f-c10f-4f49-a7e1-1e0efd7a1c91 req-61e1d824-d072-423e-b06e-e393b7d5e32e tempest-AttachVolumeTestJSON-1572753679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-f1036d21-c08e-4b2b-8ade-2de291b3e165', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '793ff58b-d178-4abd-8c10-02f0c1db56a2', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:46:48 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-d27fb08f-c10f-4f49-a7e1-1e0efd7a1c91 req-61e1d824-d072-423e-b06e-e393b7d5e32e tempest-AttachVolumeTestJSON-1572753679 None] attachment_update completed successfully. Sep 15 18:46:48 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6.7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e" returned: 0 in 0.281s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-quobyte-7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e" released by "_delete_snapshot" :: held 1.695s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-quobyte-02730d73-d56d-4832-826d-7be08423f7c6" released by "delete_snapshot" :: held 1.730s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:46:48 devstack cinder-volume[86137]: WARNING cinder.quota [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG cinder.quota [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Created reservations ['44ebdd28-1a2a-4226-b66c-a23047d18991', '6e73daff-00b3-4af6-911c-c0967ff202b4', '7a86bf6f-afd1-4e12-bd67-e7c5e98eb8cd', 'c30ef0fd-2190-4f12-901f-751e6dfae828'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:46:48 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Delete snapshot completed successfully. Sep 15 18:46:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-c9cfec91-53da-420a-8c8f-91749ca6bfae req-68887406-ee03-4f72-8753-a60f860b654d tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-7cec96b8-b96d-4ecb-abaa-ba5e2ca3696e-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:46:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Acquiring lock "cinder-02730d73-d56d-4832-826d-7be08423f7c6-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:46:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-02730d73-d56d-4832-826d-7be08423f7c6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:46:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Acquiring lock "cinder-quobyte-02730d73-d56d-4832-826d-7be08423f7c6" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:46:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-quobyte-02730d73-d56d-4832-826d-7be08423f7c6" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:46:49 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbaed97-4c27-4cc7-a067-8ebd2fd7bf53]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:46:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:49 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 Sep 15 18:46:49 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:49 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6" returned: 0 in 0.423s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:49 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6 Sep 15 18:46:49 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:50 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-02730d73-d56d-4832-826d-7be08423f7c6" returned: 0 in 0.275s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-quobyte-02730d73-d56d-4832-826d-7be08423f7c6" released by "delete_volume" :: held 0.784s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG cinder.quota [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Created reservations ['20bae419-7c87-46df-a0fc-a38169f7ea2b', 'aab7d63f-de6f-4553-950f-39083d9a66fc', '68f73273-7dc5-438f-8083-11e01bf5728e', '7a7de500-5d9b-4fff-a26a-7e101789f75a'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:46:50 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:46:50 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:46:50 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.484s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG cinder.manager [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:46:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Deleted volume successfully. Sep 15 18:46:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-aa0c1034-3270-4ebc-b3be-590a6e427cfc req-92c0b5e4-dc94-44e3-a02c-2eeb683c1672 tempest-VolumesSnapshotsTestJSON-255293038 None] Lock "cinder-02730d73-d56d-4832-826d-7be08423f7c6-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-19431183-8dd5-428a-ba33-eacc108801c4 tempest-GroupSnapshotsTest-1251960267 None] Group tempest-GroupSnapshotsTest-Group-1536777923: creating Sep 15 18:47:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-19431183-8dd5-428a-ba33-eacc108801c4 tempest-GroupSnapshotsTest-1251960267 None] Group tempest-GroupSnapshotsTest-Group-1536777923: created successfully Sep 15 18:47:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-19431183-8dd5-428a-ba33-eacc108801c4 tempest-GroupSnapshotsTest-1251960267 None] Create group completed successfully. Sep 15 18:47:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-e8fb50ea-8442-4cbb-8f52-81066f8a023f req-673baf56-7f5b-4ef1-abec-4a9914fd2e19 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-e8fb50ea-8442-4cbb-8f52-81066f8a023f req-673baf56-7f5b-4ef1-abec-4a9914fd2e19 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-e8fb50ea-8442-4cbb-8f52-81066f8a023f req-673baf56-7f5b-4ef1-abec-4a9914fd2e19 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-e8fb50ea-8442-4cbb-8f52-81066f8a023f req-673baf56-7f5b-4ef1-abec-4a9914fd2e19 tempest-ServerActionsTestOtherA-211200806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc39745f-bcd2-4387-bf27-a54f0590aae1', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:47:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-e8fb50ea-8442-4cbb-8f52-81066f8a023f req-673baf56-7f5b-4ef1-abec-4a9914fd2e19 tempest-ServerActionsTestOtherA-211200806 None] attachment_update completed successfully. Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Flow 'volume_create_manager' (7c1c658f-138b-4781-bd95-74ed865c0be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3704d05-ec39-4e46-9341-c22a4238ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3704d05-ec39-4e46-9341-c22a4238ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673040720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=553e9ac4-0461-4086-8da1-5c5544236680,host='devstack@QuobyteHD#QuobyteHD',id=9760845f-962b-437b-b35b-9d2fa3ae5968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75773f1e3b2947d4a73c2a03eb280000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:03Z,use_quota=True,user_id='9c19235601e043a68703949a7bf62e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d1684c6-f2d0-49ae-a47e-7ef967ba592c),volume_type_id=1d1684c6-f2d0-49ae-a47e-7ef967ba592c)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13edc009-5d7b-4b8d-94a9-bd994dbdcabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13edc009-5d7b-4b8d-94a9-bd994dbdcabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f0b0cd-2797-4655-b6b8-bf73461c9ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69f0b0cd-2797-4655-b6b8-bf73461c9ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9760845f-962b-437b-b35b-9d2fa3ae5968', 'volume_name': 'volume-9760845f-962b-437b-b35b-9d2fa3ae5968', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641e4e3c-4cc7-434c-95b6-1fd4168d92ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641e4e3c-4cc7-434c-95b6-1fd4168d92ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49ea4f7-d97e-422d-93aa-7f7774ebbaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:02 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Volume 9760845f-962b-437b-b35b-9d2fa3ae5968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9760845f-962b-437b-b35b-9d2fa3ae5968', 'volume_size': 1} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=553e9ac4-0461-4086-8da1-5c5544236680,created_at=2026-09-15T16:47:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673040720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=553e9ac4-0461-4086-8da1-5c5544236680,host='devstack@QuobyteHD#QuobyteHD',id=9760845f-962b-437b-b35b-9d2fa3ae5968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75773f1e3b2947d4a73c2a03eb280000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:03Z,use_quota=True,user_id='9c19235601e043a68703949a7bf62e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d1684c6-f2d0-49ae-a47e-7ef967ba592c),volume_type_id=1d1684c6-f2d0-49ae-a47e-7ef967ba592c)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Creating volume 9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:47:02 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:47:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:02 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 1073741824 Sep 15 18:47:02 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:03 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 1073741824" returned: 0 in 0.894s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:03 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 Sep 15 18:47:03 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:04 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968" returned: 0 in 0.715s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:47:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49ea4f7-d97e-422d-93aa-7f7774ebbaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9760845f-962b-437b-b35b-9d2fa3ae5968', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adc2200-51d7-4eec-97f5-def42edef20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Volume volume-9760845f-962b-437b-b35b-9d2fa3ae5968 (9760845f-962b-437b-b35b-9d2fa3ae5968): created successfully Sep 15 18:47:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1adc2200-51d7-4eec-97f5-def42edef20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Flow 'volume_create_manager' (7c1c658f-138b-4781-bd95-74ed865c0be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-00e2f89d-222a-4394-9fb3-83b851a35b41 tempest-GroupSnapshotsTest-1251960267 None] Created volume successfully. Sep 15 18:47:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] GroupSnapshot 65f1397d-8555-42f2-8332-79e9e5b9a9d0: creating. Sep 15 18:47:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Group snapshot 65f1397d-8555-42f2-8332-79e9e5b9a9d0: creating. {{(pid=86137) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 15 18:47:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Creating offline snapshot 4c49ce9e-686d-4650-ba9b-131aca5b53f8 of volume 9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:47:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[665206ff-eb65-4aa1-a687-60428f9e1dcc]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-c9e58f64-b822-4f29-9ea3-8c6189d80992 req-aba9664f-8139-4f9a-ac1c-c68fee02b78b tempest-ServerActionsTestOtherA-211200806 None] Terminate volume connection completed successfully. Sep 15 18:47:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-c9e58f64-b822-4f29-9ea3-8c6189d80992 req-aba9664f-8139-4f9a-ac1c-c68fee02b78b tempest-ServerActionsTestOtherA-211200806 None] Deleting attachment fc39745f-bcd2-4387-bf27-a54f0590aae1. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:47:06 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 Sep 15 18:47:06 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:06 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968" returned: 0 in 1.018s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:07 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 1G Sep 15 18:47:07 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-c9e58f64-b822-4f29-9ea3-8c6189d80992 req-1ad60f9b-d663-439e-ab38-75f0d924832f tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:08 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 1G" returned: 0 in 1.052s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9760845f-962b-437b-b35b-9d2fa3ae5968 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:08 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9760845f-962b-437b-b35b-9d2fa3ae5968 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 Sep 15 18:47:08 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:08 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9760845f-962b-437b-b35b-9d2fa3ae5968 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8" returned: 0 in 0.968s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:09 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:47:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:09 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 Sep 15 18:47:09 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:09 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8" returned: 0 in 0.566s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:09 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.info Sep 15 18:47:09 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:10 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.info" returned: 0 in 0.617s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:10 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:47:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:10 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.info Sep 15 18:47:10 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:10 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.info" returned: 0 in 0.479s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.929s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-c9e58f64-b822-4f29-9ea3-8c6189d80992 req-1ad60f9b-d663-439e-ab38-75f0d924832f tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.889s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-c9e58f64-b822-4f29-9ea3-8c6189d80992 req-1ad60f9b-d663-439e-ab38-75f0d924832f tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-c9e58f64-b822-4f29-9ea3-8c6189d80992 req-1ad60f9b-d663-439e-ab38-75f0d924832f tempest-ServerActionsTestOtherA-211200806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cb00554-1ad5-47e9-b1d9-5f8acc7040b0', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:47:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4fb8e05e-6d91-483e-b0f6-9f2eb9c4d81b tempest-GroupSnapshotsTest-1251960267 None] group_snapshot 65f1397d-8555-42f2-8332-79e9e5b9a9d0: created successfully Sep 15 18:47:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-c9e58f64-b822-4f29-9ea3-8c6189d80992 req-1ad60f9b-d663-439e-ab38-75f0d924832f tempest-ServerActionsTestOtherA-211200806 None] attachment_update completed successfully. Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-4c49ce9e-686d-4650-ba9b-131aca5b53f8-59b5858e-2603-4a21-a073-063bc7b48888" by "_create_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-4c49ce9e-686d-4650-ba9b-131aca5b53f8-59b5858e-2603-4a21-a073-063bc7b48888" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Creating volume 59b5858e-2603-4a21-a073-063bc7b48888 from snapshot 4c49ce9e-686d-4650-ba9b-131aca5b53f8 {{(pid=86137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-59b5858e-2603-4a21-a073-063bc7b48888" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-59b5858e-2603-4a21-a073-063bc7b48888" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] snapshot: 4c49ce9e-686d-4650-ba9b-131aca5b53f8, volume: 59b5858e-2603-4a21-a073-063bc7b48888, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676c18a-0e41-49c6-87ed-13488c5228a8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:13 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 Sep 15 18:47:13 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:14 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8" returned: 0 in 1.376s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9760845f-962b-437b-b35b-9d2fa3ae5968(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:47:14 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cceed8c-b002-4b68-8abb-25b3d0d024ca]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:15 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 Sep 15 18:47:15 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:15 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968" returned: 0 in 1.030s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 18:47:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 18:47:15 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 18:47:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:15 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 Sep 15 18:47:15 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:21 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Flow 'volume_create_manager' (e0e206c1-2eb8-48f3-a51d-467bf10a1112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e979005a-af82-41d6-a23f-19e6c3f436a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e979005a-af82-41d6-a23f-19e6c3f436a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-150889311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cb0518-e915-47b3-9f1c-3c826966e833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece6e69014044a08a4853882fdb06377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:22Z,use_quota=True,user_id='1ef8e5383f4e4f3380c1b618862adc55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8a911d-533d-4ebd-86c4-516e879e539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8a911d-533d-4ebd-86c4-516e879e539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf081388-a569-49c4-aeda-293842d23094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf081388-a569-49c4-aeda-293842d23094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8cb0518-e915-47b3-9f1c-3c826966e833', 'volume_name': 'volume-c8cb0518-e915-47b3-9f1c-3c826966e833', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d319a0-8f04-4f5f-b37b-62941a8244d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d319a0-8f04-4f5f-b37b-62941a8244d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc176dc-3073-4e30-a299-fef2eac25efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:22 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Volume c8cb0518-e915-47b3-9f1c-3c826966e833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8cb0518-e915-47b3-9f1c-3c826966e833', 'volume_size': 1} Sep 15 18:47:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:26 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888" returned: 0 in 10.259s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968, size 1024.00 MB, duration 10.26 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:47:26 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Converted 1024.00 MB image at 99.81 MB/s Sep 15 18:47:26 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:26 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 Sep 15 18:47:26 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:26 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888" returned: 0 in 0.230s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-59b5858e-2603-4a21-a073-063bc7b48888" released by "_copy_volume_from_snapshot" :: held 13.091s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-4c49ce9e-686d-4650-ba9b-131aca5b53f8-59b5858e-2603-4a21-a073-063bc7b48888" released by "_create_volume_from_snapshot" :: held 13.206s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.266s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.125s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-150889311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8cb0518-e915-47b3-9f1c-3c826966e833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece6e69014044a08a4853882fdb06377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:22Z,use_quota=True,user_id='1ef8e5383f4e4f3380c1b618862adc55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Creating volume c8cb0518-e915-47b3-9f1c-3c826966e833 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:47:26 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:26 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833 1073741824 Sep 15 18:47:26 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:26 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-305898b0-1e4e-4be5-9fba-069c9e5e7975 tempest-GroupSnapshotsTest-1251960267 None] Create group from source-snapshot-65f1397d-8555-42f2-8332-79e9e5b9a9d0 completed successfully. Sep 15 18:47:26 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833 1073741824" returned: 0 in 0.462s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:26 devstack sudo[90969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833 Sep 15 18:47:26 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:27 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833" returned: 0 in 0.297s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:47:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc176dc-3073-4e30-a299-fef2eac25efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8cb0518-e915-47b3-9f1c-3c826966e833', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f5953f-a499-4e44-8435-b3e444986c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:27 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Volume volume-c8cb0518-e915-47b3-9f1c-3c826966e833 (c8cb0518-e915-47b3-9f1c-3c826966e833): created successfully Sep 15 18:47:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f5953f-a499-4e44-8435-b3e444986c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Flow 'volume_create_manager' (e0e206c1-2eb8-48f3-a51d-467bf10a1112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:27 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3da44373-9183-40d9-bcee-de9e52ebb4e4 tempest-ServersNegativeTestJSON-1121862197 None] Created volume successfully. Sep 15 18:47:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-59b5858e-2603-4a21-a073-063bc7b48888" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-59b5858e-2603-4a21-a073-063bc7b48888" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:28 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d847f9-b779-4001-ae8c-f47c602cb0cb]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:28 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 Sep 15 18:47:28 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:28 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888" returned: 0 in 0.437s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:28 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888 Sep 15 18:47:28 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:29 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59b5858e-2603-4a21-a073-063bc7b48888" returned: 0 in 0.277s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-59b5858e-2603-4a21-a073-063bc7b48888" released by "delete_volume" :: held 0.785s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['9bfcf482-d3a4-4c66-936f-bf477ae5a0bc'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:47:29 devstack cinder-volume[86137]: WARNING cinder.quota [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1822494769 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1822494769, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:47:29 devstack cinder-volume[86137]: WARNING cinder.quota [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1822494769 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1822494769, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['fa806f15-3555-4e80-8510-1e2251cadc69', 'adbef147-3f70-4827-a1a1-30bd3e7b7d63', '5fdd6e12-87e5-431a-8345-43a0e44e8eed', '940c2cb0-dbd7-4e22-abcb-70258273cb59'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Flow 'volume_create_manager' (bb20f289-6ba4-42d5-abd1-f8a86b06dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b821433c-8c91-41d1-9392-3d886f4a2ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b821433c-8c91-41d1-9392-3d886f4a2ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1468224203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece6e69014044a08a4853882fdb06377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:29Z,use_quota=True,user_id='1ef8e5383f4e4f3380c1b618862adc55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfd080c-bf08-4e43-9518-8b113aa5484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfd080c-bf08-4e43-9518-8b113aa5484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42da632-eaec-48bc-a440-fc0376c716ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42da632-eaec-48bc-a440-fc0376c716ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46', 'volume_name': 'volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d8ee72-0c8b-4265-acf1-990c9a47b6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d8ee72-0c8b-4265-acf1-990c9a47b6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f531cad-bd11-4020-9559-72bc58b115a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:29 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Volume 8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46', 'volume_size': 1} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1468224203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece6e69014044a08a4853882fdb06377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:29Z,use_quota=True,user_id='1ef8e5383f4e4f3380c1b618862adc55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Creating volume 8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:47:29 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:29 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 1073741824 Sep 15 18:47:29 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:29 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:47:29 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] group_snapshot 65f1397d-8555-42f2-8332-79e9e5b9a9d0: deleting Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] group_snapshot 65f1397d-8555-42f2-8332-79e9e5b9a9d0: deleting {{(pid=86137) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-9760845f-962b-437b-b35b-9d2fa3ae5968" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-9760845f-962b-437b-b35b-9d2fa3ae5968" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-4c49ce9e-686d-4650-ba9b-131aca5b53f8" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-4c49ce9e-686d-4650-ba9b-131aca5b53f8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Deleting offline snapshot 4c49ce9e-686d-4650-ba9b-131aca5b53f8 of volume 9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:47:29 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] snapshot_file for this snap is: volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.326s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f64fab-68d0-43bb-8cf1-7051ccd8d73d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0c3f6dc6-eb8e-47f4-b8c3-d1e145c620a3 tempest-GroupSnapshotsTest-1251960267 None] Delete group completed successfully. Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:29 devstack sudo[90991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 Sep 15 18:47:29 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:29 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 1073741824" returned: 0 in 0.622s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:30 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 Sep 15 18:47:30 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:30 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8" returned: 0 in 0.453s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9760845f-962b-437b-b35b-9d2fa3ae5968(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3bec16-f8ac-4d9f-9d3d-67cb55b30e31]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:30 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46" returned: 0 in 0.294s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f531cad-bd11-4020-9559-72bc58b115a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7af5a4b-05a2-4504-be3b-b7c8c36a5f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:30 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Volume volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 (8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46): created successfully Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7af5a4b-05a2-4504-be3b-b7c8c36a5f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Flow 'volume_create_manager' (bb20f289-6ba4-42d5-abd1-f8a86b06dab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:30 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 Sep 15 18:47:30 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:30 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b609846c-5302-49ef-aa49-71a2c132f460 tempest-ServersNegativeTestJSON-1121862197 None] Created volume successfully. Sep 15 18:47:30 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968" returned: 0 in 0.543s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:30 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 Sep 15 18:47:30 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:31 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8" returned: 0 in 0.324s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:31 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8 Sep 15 18:47:31 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:31 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968.4c49ce9e-686d-4650-ba9b-131aca5b53f8" returned: 0 in 0.258s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-4c49ce9e-686d-4650-ba9b-131aca5b53f8" released by "_delete_snapshot" :: held 1.713s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-9760845f-962b-437b-b35b-9d2fa3ae5968" released by "delete_snapshot" :: held 1.746s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:31 devstack cinder-volume[86137]: WARNING cinder.quota [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1822494769 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1822494769, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['2260904a-d628-4415-8362-7223af5ed962', '9501d698-4aae-4cbd-a570-091e76ab7018', 'f5dc1b19-8b18-4d0b-a8bf-5bf5636e44fb', 'c4c397d0-fa9a-4a2a-be60-44a97eecf335'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:47:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bc9b1320-3f0a-43fc-af96-fe2598ca518b tempest-GroupSnapshotsTest-1251960267 None] group_snapshot 65f1397d-8555-42f2-8332-79e9e5b9a9d0: deleted successfully Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "cinder-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Lock "cinder-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "cinder-quobyte-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Lock "cinder-quobyte-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46" acquired by "delete_volume" :: waited 0.012s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef24a11-3b90-470e-a215-0d5758aa9a1b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:31 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 Sep 15 18:47:31 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:32 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46" returned: 0 in 0.362s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:32 devstack sudo[91041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46 Sep 15 18:47:32 devstack sudo[91041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-9760845f-962b-437b-b35b-9d2fa3ae5968" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-9760845f-962b-437b-b35b-9d2fa3ae5968" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a78be52-ad4b-4aab-b096-8a6a7e575707]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:32 devstack sudo[91041]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46" returned: 0 in 0.250s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Lock "cinder-quobyte-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46" released by "delete_volume" :: held 0.657s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Created reservations ['c1a26b81-e7f8-431d-8a44-0254cc9e16fc', 'f55b98fb-30f5-4410-9af7-d7195fb071f1', '58ea1cad-1288-482d-8650-a2445ecab94a', '18da80b5-42be-4957-860f-9bbd43f0c7ad'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:47:32 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 Sep 15 18:47:32 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:32 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:47:32 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:32 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968" returned: 0 in 0.375s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:32 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968 Sep 15 18:47:32 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:32 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.259s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:47:32 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Deleted volume successfully. Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e96f4570-8264-47c9-aadc-d31b8f3da9e3 tempest-ServersNegativeTestJSON-1121862197 None] Lock "cinder-8dce7f1f-c06c-4ebe-8b0e-f6d1b9af4a46-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "cinder-c8cb0518-e915-47b3-9f1c-3c826966e833-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Lock "cinder-c8cb0518-e915-47b3-9f1c-3c826966e833-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "cinder-quobyte-c8cb0518-e915-47b3-9f1c-3c826966e833" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Lock "cinder-quobyte-c8cb0518-e915-47b3-9f1c-3c826966e833" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[df94bd81-4d38-40b3-bd73-326aa7aab4fe]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:33 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9760845f-962b-437b-b35b-9d2fa3ae5968" returned: 0 in 0.284s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-9760845f-962b-437b-b35b-9d2fa3ae5968" released by "delete_volume" :: held 0.746s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:33 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833 Sep 15 18:47:33 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['f3a29bd8-c187-439e-8dd3-b5a4a19b8bec'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:47:33 devstack cinder-volume[86137]: WARNING cinder.db.api [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1822494769'] Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['9ff4df8e-4634-46a0-803f-06bd1288ff91', '54be82c8-ea38-43e1-9937-595c207fb3de', '7e975ee5-422e-4974-be30-a89d7b3dbd11', 'ef8adb2f-04b7-4381-9104-7f602160045e'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:33 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:47:33 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:33 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833" returned: 0 in 0.371s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:33 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833 Sep 15 18:47:33 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:33 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.285s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:47:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e7abb4b6-63d4-4f41-905b-d890b5cea3be tempest-GroupSnapshotsTest-1251960267 None] Delete group completed successfully. Sep 15 18:47:33 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c8cb0518-e915-47b3-9f1c-3c826966e833" returned: 0 in 0.263s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Lock "cinder-quobyte-c8cb0518-e915-47b3-9f1c-3c826966e833" released by "delete_volume" :: held 0.679s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=84,cinder:UPDATE=76,cinder:INSERT=18,cinder:DELETE=4 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Created reservations ['21d0d86c-43ab-47d3-83cd-155db9a1ebc5', '38c0259f-5c33-4b5b-9df4-29b2cc07ac29', 'd6eada16-be78-46b3-b406-7af97245b428', '8ba2ebe9-61e7-41ef-907f-446f8b806a43'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:33 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:47:33 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6df1f3fc-a8e7-4ac4-b32d-99dde31ea300 tempest-GroupSnapshotsTest-1251960267 None] Group tempest-GroupSnapshotsTest-Group-1355582473: creating Sep 15 18:47:33 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.252s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:47:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Deleted volume successfully. Sep 15 18:47:33 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=98,cinder:UPDATE=84,cinder:DELETE=5,cinder:INSERT=18 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:47:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6df1f3fc-a8e7-4ac4-b32d-99dde31ea300 tempest-GroupSnapshotsTest-1251960267 None] Group tempest-GroupSnapshotsTest-Group-1355582473: created successfully Sep 15 18:47:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2d542d22-5dfd-42ff-884f-7d6200270bcb tempest-ServersNegativeTestJSON-1121862197 None] Lock "cinder-c8cb0518-e915-47b3-9f1c-3c826966e833-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:34 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6df1f3fc-a8e7-4ac4-b32d-99dde31ea300 tempest-GroupSnapshotsTest-1251960267 None] Create group completed successfully. Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Flow 'volume_create_manager' (25359ac2-7d71-43de-a864-0e17ac5b5e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5aef7f7-a720-46ba-8ec1-6613f859f6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5aef7f7-a720-46ba-8ec1-6613f859f6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1107999650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d21c84d-2251-4048-a98b-34c862bc8b8c,host='devstack@QuobyteHD#QuobyteHD',id=cc938b39-035e-41f0-a124-f6276d9912e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75773f1e3b2947d4a73c2a03eb280000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:36Z,use_quota=True,user_id='9c19235601e043a68703949a7bf62e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b24deab2-42a4-4097-8b76-1c5309afb1ff),volume_type_id=b24deab2-42a4-4097-8b76-1c5309afb1ff)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d09df0-8f57-4e29-97aa-b46d8872089c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87d09df0-8f57-4e29-97aa-b46d8872089c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a850a323-acfa-4e48-8c38-e3595c6288a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a850a323-acfa-4e48-8c38-e3595c6288a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc938b39-035e-41f0-a124-f6276d9912e8', 'volume_name': 'volume-cc938b39-035e-41f0-a124-f6276d9912e8', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106d6139-5c48-444b-b6da-8919e8b41cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106d6139-5c48-444b-b6da-8919e8b41cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda04ff5-6d9d-498e-89d0-4ac73413a098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:35 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Volume cc938b39-035e-41f0-a124-f6276d9912e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc938b39-035e-41f0-a124-f6276d9912e8', 'volume_size': 1} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d21c84d-2251-4048-a98b-34c862bc8b8c,created_at=2026-09-15T16:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1107999650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d21c84d-2251-4048-a98b-34c862bc8b8c,host='devstack@QuobyteHD#QuobyteHD',id=cc938b39-035e-41f0-a124-f6276d9912e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75773f1e3b2947d4a73c2a03eb280000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:36Z,use_quota=True,user_id='9c19235601e043a68703949a7bf62e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b24deab2-42a4-4097-8b76-1c5309afb1ff),volume_type_id=b24deab2-42a4-4097-8b76-1c5309afb1ff)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Creating volume cc938b39-035e-41f0-a124-f6276d9912e8 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:47:35 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:47:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:35 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 1073741824 Sep 15 18:47:35 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:36 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 1073741824" returned: 0 in 0.514s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:36 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 Sep 15 18:47:36 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:36 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8" returned: 0 in 0.242s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:47:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda04ff5-6d9d-498e-89d0-4ac73413a098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc938b39-035e-41f0-a124-f6276d9912e8', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957c6855-53df-4eea-93c9-a7ac375369f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:36 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Volume volume-cc938b39-035e-41f0-a124-f6276d9912e8 (cc938b39-035e-41f0-a124-f6276d9912e8): created successfully Sep 15 18:47:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (957c6855-53df-4eea-93c9-a7ac375369f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Flow 'volume_create_manager' (25359ac2-7d71-43de-a864-0e17ac5b5e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:36 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-23f32e04-c3de-41e2-a380-38ad9be4314f tempest-GroupSnapshotsTest-1251960267 None] Created volume successfully. Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Flow 'volume_create_manager' (befa16d2-ee51-4ca0-b34b-a768798c138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747940c2-76e7-48eb-8234-62310368653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747940c2-76e7-48eb-8234-62310368653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-142770985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d21c84d-2251-4048-a98b-34c862bc8b8c,host='devstack@QuobyteHD#QuobyteHD',id=dbb5902d-b57b-41ad-afb5-18ccc734716d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75773f1e3b2947d4a73c2a03eb280000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:37Z,use_quota=True,user_id='9c19235601e043a68703949a7bf62e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b24deab2-42a4-4097-8b76-1c5309afb1ff),volume_type_id=b24deab2-42a4-4097-8b76-1c5309afb1ff)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce39841b-f5dc-4796-998c-1c4704e0ce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce39841b-f5dc-4796-998c-1c4704e0ce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fddbb6-3e16-4e3b-a53f-8568feb5ac8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85fddbb6-3e16-4e3b-a53f-8568feb5ac8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbb5902d-b57b-41ad-afb5-18ccc734716d', 'volume_name': 'volume-dbb5902d-b57b-41ad-afb5-18ccc734716d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c790afd-65ad-4cf0-97b6-c4a249e05c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c790afd-65ad-4cf0-97b6-c4a249e05c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b5b41c-c062-4e91-8142-ec84f428888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:37 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Volume dbb5902d-b57b-41ad-afb5-18ccc734716d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbb5902d-b57b-41ad-afb5-18ccc734716d', 'volume_size': 1} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d21c84d-2251-4048-a98b-34c862bc8b8c,created_at=2026-09-15T16:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-142770985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d21c84d-2251-4048-a98b-34c862bc8b8c,host='devstack@QuobyteHD#QuobyteHD',id=dbb5902d-b57b-41ad-afb5-18ccc734716d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75773f1e3b2947d4a73c2a03eb280000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:37Z,use_quota=True,user_id='9c19235601e043a68703949a7bf62e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b24deab2-42a4-4097-8b76-1c5309afb1ff),volume_type_id=b24deab2-42a4-4097-8b76-1c5309afb1ff)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Creating volume dbb5902d-b57b-41ad-afb5-18ccc734716d {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:47:37 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:47:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:37 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d 1073741824 Sep 15 18:47:37 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:38 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d 1073741824" returned: 0 in 0.540s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:38 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d Sep 15 18:47:38 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:38 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d" returned: 0 in 0.328s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b5b41c-c062-4e91-8142-ec84f428888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbb5902d-b57b-41ad-afb5-18ccc734716d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c6e606-424b-4c77-8532-6b469d042dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:38 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Volume volume-dbb5902d-b57b-41ad-afb5-18ccc734716d (dbb5902d-b57b-41ad-afb5-18ccc734716d): created successfully Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c6e606-424b-4c77-8532-6b469d042dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Flow 'volume_create_manager' (befa16d2-ee51-4ca0-b34b-a768798c138d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f032cad1-3811-4a4c-bce5-b82c28565d2a tempest-GroupSnapshotsTest-1251960267 None] Created volume successfully. Sep 15 18:47:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-99ebc85e-5a95-44e4-b972-903b2a01758e req-78eff7fa-744f-452c-9a11-5ee187c152ab tempest-AttachVolumeTestJSON-1572753679 None] Terminate volume connection completed successfully. Sep 15 18:47:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-99ebc85e-5a95-44e4-b972-903b2a01758e req-78eff7fa-744f-452c-9a11-5ee187c152ab tempest-AttachVolumeTestJSON-1572753679 None] Deleting attachment 793ff58b-d178-4abd-8c10-02f0c1db56a2. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:47:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d50cc5b7-aa3a-4ed4-8195-fc856df78bb4 tempest-GroupSnapshotsTest-1251960267 None] Update group completed successfully. Sep 15 18:47:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f6303212-6165-402f-b5cd-d834f456e875 tempest-GroupSnapshotsTest-1251960267 None] Update group completed successfully. Sep 15 18:47:41 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-be6920d4-d417-4324-bea8-e8372f2ebeef req-97ff6e75-ed14-4392-ba65-ab2283242050 tempest-ServerActionsTestOtherA-211200806 None] Terminate volume connection completed successfully. Sep 15 18:47:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-be6920d4-d417-4324-bea8-e8372f2ebeef req-97ff6e75-ed14-4392-ba65-ab2283242050 tempest-ServerActionsTestOtherA-211200806 None] Deleting attachment 7cb00554-1ad5-47e9-b1d9-5f8acc7040b0. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:47:41 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-882ed999-3cc0-4f79-8bd1-441c40831cf5 tempest-GroupSnapshotsTest-1251960267 None] Update group completed successfully. Sep 15 18:47:42 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-efe8b216-6315-4d57-9d9d-1271689a125b tempest-GroupSnapshotsTest-1251960267 None] Update group completed successfully. Sep 15 18:47:44 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] GroupSnapshot 41cc1d18-24b4-4bae-8d06-b091d1577403: creating. Sep 15 18:47:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Group snapshot 41cc1d18-24b4-4bae-8d06-b091d1577403: creating. {{(pid=86137) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 15 18:47:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Creating offline snapshot bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 of volume cc938b39-035e-41f0-a124-f6276d9912e8 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:47:44 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb2e2b1-e594-4451-be59-d2af6fa04404]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:44 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 Sep 15 18:47:44 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:45 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8" returned: 0 in 0.709s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:45 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 1G Sep 15 18:47:45 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:47:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:45 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:47:45 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:46 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.534s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:47:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:47:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 8 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:47:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:47:46 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 1G" returned: 0 in 0.929s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc938b39-035e-41f0-a124-f6276d9912e8 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:46 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc938b39-035e-41f0-a124-f6276d9912e8 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 Sep 15 18:47:46 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:46 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc938b39-035e-41f0-a124-f6276d9912e8 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8" returned: 0 in 0.522s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:46 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:47:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:46 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 Sep 15 18:47:46 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:47 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8" returned: 0 in 0.291s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:47 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.info Sep 15 18:47:47 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:47 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.info" returned: 0 in 0.315s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:47 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:47:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:47 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.info Sep 15 18:47:47 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:48 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.info" returned: 0 in 0.466s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.447s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Creating offline snapshot e94d62f2-2a1c-4b2a-967e-e56c1192ee74 of volume dbb5902d-b57b-41ad-afb5-18ccc734716d {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:47:48 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff490d98-87f8-48bc-8444-45e29e89e3f2]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:48 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d Sep 15 18:47:48 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:48 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d" returned: 0 in 0.525s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:48 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 1G Sep 15 18:47:48 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:49 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 1G" returned: 0 in 0.591s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbb5902d-b57b-41ad-afb5-18ccc734716d -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:49 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbb5902d-b57b-41ad-afb5-18ccc734716d -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 Sep 15 18:47:49 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:49 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbb5902d-b57b-41ad-afb5-18ccc734716d -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74" returned: 0 in 0.367s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:49 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:47:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:49 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 Sep 15 18:47:49 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:50 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74" returned: 0 in 0.377s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:50 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.info Sep 15 18:47:50 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:50 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.info" returned: 0 in 0.308s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:50 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:47:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:50 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.info Sep 15 18:47:50 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:50 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.info" returned: 0 in 0.316s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9750d899-d7a6-433f-8ac3-03613a01c753 tempest-GroupSnapshotsTest-1251960267 None] group_snapshot 41cc1d18-24b4-4bae-8d06-b091d1577403: created successfully Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Flow 'volume_create_manager' (2798c299-1ffb-4815-a195-b8cd0409acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1fe72f-b9ab-4c99-a5c6-0743993b43cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1fe72f-b9ab-4c99-a5c6-0743993b43cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1373557671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd631729-0188-4b24-ba8c-344bca2a7fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181727b6a1dd43daba93b54ce4e2b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:51Z,use_quota=True,user_id='ab0b0652d1ca4753a70caa70b3212e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d22ee92-57a6-4f8e-ad49-622172f5628f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d22ee92-57a6-4f8e-ad49-622172f5628f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b188f3-fc9e-48ab-a914-32294d67f91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 18:47:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] group_snapshot 41cc1d18-24b4-4bae-8d06-b091d1577403: deleting Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] group_snapshot 41cc1d18-24b4-4bae-8d06-b091d1577403: deleting {{(pid=86137) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-cc938b39-035e-41f0-a124-f6276d9912e8" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-cc938b39-035e-41f0-a124-f6276d9912e8" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-bb4ddd7c-ac83-49db-b86b-e652ca98f2f8" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-bb4ddd7c-ac83-49db-b86b-e652ca98f2f8" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Deleting offline snapshot bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 of volume cc938b39-035e-41f0-a124-f6276d9912e8 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] snapshot_file for this snap is: volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a7388a-4d8c-4d72-8292-452fb41c7321]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b188f3-fc9e-48ab-a914-32294d67f91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd631729-0188-4b24-ba8c-344bca2a7fc2', 'volume_name': 'volume-bd631729-0188-4b24-ba8c-344bca2a7fc2', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a690daa-9bf9-49eb-97eb-b1951cc4ba39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a690daa-9bf9-49eb-97eb-b1951cc4ba39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f89821-d133-46ed-9ff3-3db5066c8954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Volume bd631729-0188-4b24-ba8c-344bca2a7fc2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd631729-0188-4b24-ba8c-344bca2a7fc2', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 18:47:51 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Trying to clone bd631729-0188-4b24-ba8c-344bca2a7fc2 from image cb9e9155-abe1-4ceb-8a92-39c0a579534a at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 18:47:52 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 Sep 15 18:47:52 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:52 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:52 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 18:47:52 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Image download 20.69 MB at 20.69 MB/s Sep 15 18:47:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8" returned: 0 in 0.707s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc938b39-035e-41f0-a124-f6276d9912e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:47:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdcb27d-6ac7-4888-a97f-7e6e59475ab7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[88668d6a-1db6-4396-a35b-cb210a770d7d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:52 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD Sep 15 18:47:52 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:52 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 Sep 15 18:47:52 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:53 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:53 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8" returned: 0 in 0.471s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a is fetched for user ab0b0652d1ca4753a70caa70b3212e18. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 18:47:53 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 Sep 15 18:47:53 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4f2b2c-4d26-4f51-b7ae-549507f2117e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:53 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD Sep 15 18:47:53 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:53 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8" returned: 0 in 0.509s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:53 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8 Sep 15 18:47:53 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:53 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:47:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1373557671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd631729-0188-4b24-ba8c-344bca2a7fc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181727b6a1dd43daba93b54ce4e2b013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:47:51Z,use_quota=True,user_id='ab0b0652d1ca4753a70caa70b3212e18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Creating volume bd631729-0188-4b24-ba8c-344bca2a7fc2 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:47:53 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:47:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:53 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 1073741824 Sep 15 18:47:53 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:54 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8.bb4ddd7c-ac83-49db-b86b-e652ca98f2f8" returned: 0 in 0.400s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-bb4ddd7c-ac83-49db-b86b-e652ca98f2f8" released by "_delete_snapshot" :: held 2.366s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-cc938b39-035e-41f0-a124-f6276d9912e8" released by "delete_snapshot" :: held 2.425s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-dbb5902d-b57b-41ad-afb5-18ccc734716d" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-dbb5902d-b57b-41ad-afb5-18ccc734716d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-e94d62f2-2a1c-4b2a-967e-e56c1192ee74" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-e94d62f2-2a1c-4b2a-967e-e56c1192ee74" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Deleting offline snapshot e94d62f2-2a1c-4b2a-967e-e56c1192ee74 of volume dbb5902d-b57b-41ad-afb5-18ccc734716d {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] snapshot_file for this snap is: volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34c6acc-0966-4907-a357-3a7216179def]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:54 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 Sep 15 18:47:54 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:54 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 1073741824" returned: 0 in 0.835s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:54 devstack sudo[91386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 Sep 15 18:47:54 devstack sudo[91386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:54 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74" returned: 0 in 0.671s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbb5902d-b57b-41ad-afb5-18ccc734716d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:47:55 devstack sudo[91386]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2" returned: 0 in 0.363s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dda264-01de-44c7-b4ba-70cfd99bd55d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Attempting download of cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume bd631729-0188-4b24-ba8c-344bca2a7fc2. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8951d5c-2ee9-4cd4-9a68-a7d54aca8a50]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_myo57e6k {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:55 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d Sep 15 18:47:55 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:55 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_myo57e6k Sep 15 18:47:55 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:55 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d" returned: 0 in 0.558s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:55 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 Sep 15 18:47:55 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:55 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_myo57e6k" returned: 0 in 0.529s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_myo57e6k {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:55 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_myo57e6k Sep 15 18:47:55 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:56 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_myo57e6k" returned: 1 in 0.408s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_myo57e6k' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcd3887-ea9d-4422-a665-33e4e4ff77b3]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:56 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74" returned: 0 in 0.622s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:56 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74 Sep 15 18:47:56 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:56 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD Sep 15 18:47:56 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:56 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] cb9e9155-abe1-4ceb-8a92-39c0a579534a was qcow2, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:56 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d.e94d62f2-2a1c-4b2a-967e-e56c1192ee74" returned: 0 in 0.409s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:56 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 Sep 15 18:47:56 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-e94d62f2-2a1c-4b2a-967e-e56c1192ee74" released by "_delete_snapshot" :: held 2.420s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-dbb5902d-b57b-41ad-afb5-18ccc734716d" released by "delete_snapshot" :: held 2.457s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:56 devstack cinder-volume[86137]: WARNING cinder.quota [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1173045747 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1173045747, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:47:56 devstack cinder-volume[86137]: WARNING cinder.quota [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1173045747 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1173045747, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['fd0a3c48-77ce-4c91-b3be-f479bf93317f', '26a32a97-618a-4f48-84c3-d08b28099563', '01c84b87-94c0-4c4e-9a17-5eff54b562e2', '1c2bee16-45eb-4f55-87d8-3a595457e466'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:47:56 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['65868991-77f6-4a0a-be71-cf01ebada1ce', 'd84df4c0-ca08-44d3-9cd1-755bd97fe2d7', '8eee8eb9-edd0-4085-9047-d86e547b96ba', '71a34364-318f-474e-baeb-199fe789f72d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:47:57 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f612f7c3-ce67-4d60-8aa0-8058ed4cabbc tempest-GroupSnapshotsTest-1251960267 None] group_snapshot 41cc1d18-24b4-4bae-8d06-b091d1577403: deleted successfully Sep 15 18:47:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-cc938b39-035e-41f0-a124-f6276d9912e8" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-cc938b39-035e-41f0-a124-f6276d9912e8" acquired by "delete_volume" :: waited 0.041s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:58 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[355167c7-6240-4baa-97cc-395e9c673a35]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:58 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 Sep 15 18:47:58 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:59 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8" returned: 0 in 0.590s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:59 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8 Sep 15 18:47:59 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:59 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2" returned: 0 in 2.724s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_4wviydwgdevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:47:59 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Converted 112.00 MB image at 41.10 MB/s Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:59 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 1G Sep 15 18:47:59 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:59 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cc938b39-035e-41f0-a124-f6276d9912e8" returned: 0 in 0.367s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-cc938b39-035e-41f0-a124-f6276d9912e8" released by "delete_volume" :: held 1.083s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-dbb5902d-b57b-41ad-afb5-18ccc734716d" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-dbb5902d-b57b-41ad-afb5-18ccc734716d" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5782c6a-277c-42a2-9ff0-51289186a8d9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:59 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d Sep 15 18:47:59 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:47:59 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 1G" returned: 0 in 0.426s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Downloaded image cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume bd631729-0188-4b24-ba8c-344bca2a7fc2 successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a for user ab0b0652d1ca4753a70caa70b3212e18 is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Marking volume bd631729-0188-4b24-ba8c-344bca2a7fc2 as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Copying metadata from image cb9e9155-abe1-4ceb-8a92-39c0a579534a to bd631729-0188-4b24-ba8c-344bca2a7fc2. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Creating volume glance metadata for volume bd631729-0188-4b24-ba8c-344bca2a7fc2 backed by image cb9e9155-abe1-4ceb-8a92-39c0a579534a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f89821-d133-46ed-9ff3-3db5066c8954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd631729-0188-4b24-ba8c-344bca2a7fc2', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d84c5a-c4da-4c32-b1dc-8a233a986b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:47:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Volume volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 (bd631729-0188-4b24-ba8c-344bca2a7fc2): created successfully Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d84c5a-c4da-4c32-b1dc-8a233a986b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Flow 'volume_create_manager' (2798c299-1ffb-4815-a195-b8cd0409acbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:47:59 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e4854ad2-d19c-48a7-94db-d701363e94a0 tempest-ServerActionsTestOtherA-211200806 None] Created volume successfully. Sep 15 18:47:59 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d" returned: 0 in 0.461s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:47:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:47:59 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d Sep 15 18:47:59 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:00 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-dbb5902d-b57b-41ad-afb5-18ccc734716d" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-dbb5902d-b57b-41ad-afb5-18ccc734716d" released by "delete_volume" :: held 0.809s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['fdc1c30a-5588-4aaa-9fbb-0b6e8fe0d8dd'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:48:00 devstack cinder-volume[86137]: WARNING cinder.quota [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1173045747 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1173045747, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['b75fe9b5-d2a9-4027-a064-4619f61514d4', '5d6755c0-ca6d-46e2-8ee0-3c0e3a0abb7d', '60784478-1c24-4b6c-830a-8aded774d707', 'f1178204-9604-49de-973a-10ea6e194d06'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['6766d95b-db8c-4a3b-9049-2c97539877fa', '1d373bb1-affb-4ada-8f54-99f5f8184516', 'd6b2c10b-67b5-4059-a7e7-1947264138f0', '83b7056c-e6b8-4cb3-946e-b82bbabcb30e'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:00 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:48:00 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:00 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.334s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:00 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:48:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1e7bd73c-d4c2-463e-ac67-6f3258204408 tempest-GroupSnapshotsTest-1251960267 None] Delete group completed successfully. Sep 15 18:48:01 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-fcabe689-1fce-45fc-bd6f-7e2fbf3163b3 tempest-GroupSnapshotsTest-1251960267 None] Group tempest-GroupSnapshotsTest-Group-1106903786: creating Sep 15 18:48:01 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-fcabe689-1fce-45fc-bd6f-7e2fbf3163b3 tempest-GroupSnapshotsTest-1251960267 None] Group tempest-GroupSnapshotsTest-Group-1106903786: created successfully Sep 15 18:48:01 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-fcabe689-1fce-45fc-bd6f-7e2fbf3163b3 tempest-GroupSnapshotsTest-1251960267 None] Create group completed successfully. Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Flow 'volume_create_manager' (9fe43972-bdde-48bd-bdd6-6c38f2301116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca64a52-b67e-4c11-8eb2-affd5c784034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca64a52-b67e-4c11-8eb2-affd5c784034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-59450949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e631746-d44f-47c0-a324-4856a6d20b75,host='devstack@QuobyteHD#QuobyteHD',id=612c4154-9b46-4c9a-a3db-8b57ac40ba1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75773f1e3b2947d4a73c2a03eb280000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:48:03Z,use_quota=True,user_id='9c19235601e043a68703949a7bf62e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(206e4a98-7297-4acb-bd29-93c81b996ad9),volume_type_id=206e4a98-7297-4acb-bd29-93c81b996ad9)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5284577-2894-482a-bf0b-bf8acfb50313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5284577-2894-482a-bf0b-bf8acfb50313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66395a6-657e-4bb7-96ea-34c41102b7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66395a6-657e-4bb7-96ea-34c41102b7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612c4154-9b46-4c9a-a3db-8b57ac40ba1f', 'volume_name': 'volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9adeb8a-6351-4680-99b6-8fe501d8b395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9adeb8a-6351-4680-99b6-8fe501d8b395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271aabbf-df69-49e9-b6d3-1f56941912fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Volume 612c4154-9b46-4c9a-a3db-8b57ac40ba1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f', 'volume_size': 1} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e631746-d44f-47c0-a324-4856a6d20b75,created_at=2026-09-15T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-59450949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e631746-d44f-47c0-a324-4856a6d20b75,host='devstack@QuobyteHD#QuobyteHD',id=612c4154-9b46-4c9a-a3db-8b57ac40ba1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75773f1e3b2947d4a73c2a03eb280000',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:48:03Z,use_quota=True,user_id='9c19235601e043a68703949a7bf62e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(206e4a98-7297-4acb-bd29-93c81b996ad9),volume_type_id=206e4a98-7297-4acb-bd29-93c81b996ad9)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Creating volume 612c4154-9b46-4c9a-a3db-8b57ac40ba1f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:48:03 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:03 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f 1073741824 Sep 15 18:48:03 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-6e2ed770-f9da-486c-aa1b-f76eaa7af7b4 req-5d43afcd-0bff-4619-acae-649958f2868f tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:04 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f 1073741824" returned: 0 in 0.669s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:04 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f Sep 15 18:48:04 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:04 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" returned: 0 in 0.348s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-6e2ed770-f9da-486c-aa1b-f76eaa7af7b4 req-5d43afcd-0bff-4619-acae-649958f2868f tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.545s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271aabbf-df69-49e9-b6d3-1f56941912fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f74fe3f-6cd6-443e-a879-fe47491ca665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-6e2ed770-f9da-486c-aa1b-f76eaa7af7b4 req-5d43afcd-0bff-4619-acae-649958f2868f tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Volume volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f (612c4154-9b46-4c9a-a3db-8b57ac40ba1f): created successfully Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f74fe3f-6cd6-443e-a879-fe47491ca665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Flow 'volume_create_manager' (9fe43972-bdde-48bd-bdd6-6c38f2301116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:48:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a1a29a4b-95c6-465d-a3bf-06d11b29d8a9 tempest-GroupSnapshotsTest-1251960267 None] Created volume successfully. Sep 15 18:48:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-6e2ed770-f9da-486c-aa1b-f76eaa7af7b4 req-5d43afcd-0bff-4619-acae-649958f2868f tempest-ServerActionsTestOtherA-211200806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-bd631729-0188-4b24-ba8c-344bca2a7fc2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '80da9cc1-00c3-4de8-8fa1-7120e2dfc509', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:48:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-6e2ed770-f9da-486c-aa1b-f76eaa7af7b4 req-5d43afcd-0bff-4619-acae-649958f2868f tempest-ServerActionsTestOtherA-211200806 None] attachment_update completed successfully. Sep 15 18:48:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] GroupSnapshot a392be74-810d-4636-9b85-8fab84047097: creating. Sep 15 18:48:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Group snapshot a392be74-810d-4636-9b85-8fab84047097: creating. {{(pid=86137) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 15 18:48:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Creating offline snapshot ea1e216c-fc91-451e-b674-2dd3ce496089 of volume 612c4154-9b46-4c9a-a3db-8b57ac40ba1f {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:48:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee226d5f-d4b1-421c-8161-33a826759710]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:48:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:06 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f Sep 15 18:48:06 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:06 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" returned: 0 in 0.529s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:06 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 1G Sep 15 18:48:06 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:07 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 1G" returned: 0 in 0.602s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:07 devstack sudo[91513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 Sep 15 18:48:07 devstack sudo[91513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:07 devstack sudo[91513]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089" returned: 0 in 0.598s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:07 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:48:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:07 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 Sep 15 18:48:07 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:08 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089" returned: 0 in 0.419s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:08 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.info Sep 15 18:48:08 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:08 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.info" returned: 0 in 0.429s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:08 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:48:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:08 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.info Sep 15 18:48:08 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:09 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.info" returned: 0 in 0.405s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.186s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:09 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3700338a-d967-48c6-b5f7-270030cb7fdd tempest-GroupSnapshotsTest-1251960267 None] group_snapshot a392be74-810d-4636-9b85-8fab84047097: created successfully Sep 15 18:48:10 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] group_snapshot a392be74-810d-4636-9b85-8fab84047097: deleting Sep 15 18:48:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] group_snapshot a392be74-810d-4636-9b85-8fab84047097: deleting {{(pid=86137) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 15 18:48:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:48:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:48:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-ea1e216c-fc91-451e-b674-2dd3ce496089" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:48:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-ea1e216c-fc91-451e-b674-2dd3ce496089" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:48:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Deleting offline snapshot ea1e216c-fc91-451e-b674-2dd3ce496089 of volume 612c4154-9b46-4c9a-a3db-8b57ac40ba1f {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:48:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] snapshot_file for this snap is: volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:48:11 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d9d246-23c0-422f-887d-5cf6c678d614]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:48:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:11 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 Sep 15 18:48:11 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:12 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089" returned: 0 in 1.252s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:48:12 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[923dc3da-50a8-4bd2-b5d9-dee9acb466c1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:48:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:13 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f Sep 15 18:48:13 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:13 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" returned: 0 in 1.320s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:14 devstack sudo[92084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 Sep 15 18:48:14 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:14 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089" returned: 0 in 0.960s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:15 devstack sudo[92100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089 Sep 15 18:48:15 devstack sudo[92100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:15 devstack sudo[92100]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f.ea1e216c-fc91-451e-b674-2dd3ce496089" returned: 0 in 0.920s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-ea1e216c-fc91-451e-b674-2dd3ce496089" released by "_delete_snapshot" :: held 4.786s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:48:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" released by "delete_snapshot" :: held 4.838s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:48:16 devstack cinder-volume[86137]: WARNING cinder.quota [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1736879099 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1736879099, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:48:16 devstack cinder-volume[86137]: WARNING cinder.quota [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1736879099 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1736879099, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:48:16 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['e7cfc0b7-5d80-4f18-a83d-e8386843b9c0', '0376bd01-40b0-41dc-bc0f-00b62dda9f51', '23c0d38e-9f8f-4bf9-83f0-029a6457aa92', '3ed790bf-a42f-42e9-9887-49ce72e5dc53'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:48:16 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-86b5d376-8245-4fd8-8acb-97193f83adcf tempest-GroupSnapshotsTest-1251960267 None] group_snapshot a392be74-810d-4636-9b85-8fab84047097: deleted successfully Sep 15 18:48:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "cinder-quobyte-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:48:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:48:17 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce908fc1-1d89-4666-867b-f23e3581cb2b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:48:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:18 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f Sep 15 18:48:18 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:18 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" returned: 0 in 0.751s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:18 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f Sep 15 18:48:18 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:19 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" returned: 0 in 0.513s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Lock "cinder-quobyte-612c4154-9b46-4c9a-a3db-8b57ac40ba1f" released by "delete_volume" :: held 1.406s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['fee397f1-82a0-4e82-852e-683fb75fa064'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:48:19 devstack cinder-volume[86137]: WARNING cinder.quota [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1736879099 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1736879099, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Created reservations ['15e1e165-ebda-43e8-9dff-e586f7bc114b', '662beb9d-64e2-4792-95db-3d54f6f313c7', '64dfa0df-c605-4f59-808c-47dac7c18c78', '2d9efe11-729e-4dd6-8d1e-5b1a1acff02c'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:19 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:48:19 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:20 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.613s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:20 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:48:20 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e0c66623-2a95-4c65-a11a-73f1a68df65c tempest-GroupSnapshotsTest-1251960267 None] Delete group completed successfully. Sep 15 18:48:29 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:INSERT=26,cinder:UPDATE=68,cinder:SELECT=91 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:48:29 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=88,cinder:SELECT=88,cinder:DELETE=4,cinder:INSERT=22 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:48:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-4803ba58-1c4b-4291-a75b-8d06abc4054d req-e1768c2a-f31c-49b1-af04-e6a96918fd2e tempest-ServerActionsTestOtherA-211200806 None] Terminate volume connection completed successfully. Sep 15 18:48:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-4803ba58-1c4b-4291-a75b-8d06abc4054d req-e1768c2a-f31c-49b1-af04-e6a96918fd2e tempest-ServerActionsTestOtherA-211200806 None] Deleting attachment 80da9cc1-00c3-4de8-8fa1-7120e2dfc509. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:48:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-4803ba58-1c4b-4291-a75b-8d06abc4054d req-0da2dded-69e7-4e78-8c6d-99a2fb0e77d9 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-4803ba58-1c4b-4291-a75b-8d06abc4054d req-0da2dded-69e7-4e78-8c6d-99a2fb0e77d9 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-4803ba58-1c4b-4291-a75b-8d06abc4054d req-0da2dded-69e7-4e78-8c6d-99a2fb0e77d9 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-4803ba58-1c4b-4291-a75b-8d06abc4054d req-0da2dded-69e7-4e78-8c6d-99a2fb0e77d9 tempest-ServerActionsTestOtherA-211200806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-bd631729-0188-4b24-ba8c-344bca2a7fc2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4125a167-4512-4b13-b8a5-4dcd153c68d2', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:48:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-4803ba58-1c4b-4291-a75b-8d06abc4054d req-0da2dded-69e7-4e78-8c6d-99a2fb0e77d9 tempest-ServerActionsTestOtherA-211200806 None] attachment_update completed successfully. Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Flow 'volume_create_manager' (84c732d2-e472-4d64-b465-8281afa03918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c4b3e2-54dd-45be-a29f-a9840c4e461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c4b3e2-54dd-45be-a29f-a9840c4e461e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-617569492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425e65e7-af27-4485-b784-cba1b6e8bf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d092ed23b942fc8c9bad209b3c1f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:48:41Z,use_quota=True,user_id='333143f5c54842a08453a1895b205a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bfc168-5222-4f25-a113-95f892a8a9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bfc168-5222-4f25-a113-95f892a8a9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277fb047-b193-4967-bdce-5d4abeaaf6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277fb047-b193-4967-bdce-5d4abeaaf6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425e65e7-af27-4485-b784-cba1b6e8bf7a', 'volume_name': 'volume-425e65e7-af27-4485-b784-cba1b6e8bf7a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b95a28f-5a1e-4575-9ac2-0238532667da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b95a28f-5a1e-4575-9ac2-0238532667da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fab283-b2a9-49ad-a49f-16c012fd6479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:40 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Volume 425e65e7-af27-4485-b784-cba1b6e8bf7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425e65e7-af27-4485-b784-cba1b6e8bf7a', 'volume_size': 1} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-617569492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425e65e7-af27-4485-b784-cba1b6e8bf7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0d092ed23b942fc8c9bad209b3c1f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:48:41Z,use_quota=True,user_id='333143f5c54842a08453a1895b205a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Creating volume 425e65e7-af27-4485-b784-cba1b6e8bf7a {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:48:40 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:48:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:41 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a 1073741824 Sep 15 18:48:41 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:42 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a 1073741824" returned: 0 in 1.258s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:42 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a Sep 15 18:48:42 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:42 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a" returned: 0 in 0.601s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] <== create_volume: return (1995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:48:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fab283-b2a9-49ad-a49f-16c012fd6479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425e65e7-af27-4485-b784-cba1b6e8bf7a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4f8041-e7d9-430e-83fc-a3dc2d92db0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:43 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Volume volume-425e65e7-af27-4485-b784-cba1b6e8bf7a (425e65e7-af27-4485-b784-cba1b6e8bf7a): created successfully Sep 15 18:48:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4f8041-e7d9-430e-83fc-a3dc2d92db0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Flow 'volume_create_manager' (84c732d2-e472-4d64-b465-8281afa03918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:48:43 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-91ab7d27-23c7-4061-8542-2e0b039c2e51 tempest-AttachVolumeShelveTestJSON-1243291534 None] Created volume successfully. Sep 15 18:48:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:48:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:48:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:48:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:45 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:48:45 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:48:46 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Sep 15 18:48:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.511s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:48:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:48:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:48:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 28 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:48:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:48:53 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:48:53 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:48:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-3f0fde51-bc58-4325-b757-62a0c3f3ac64 req-6be201da-e2dc-43f5-9df1-dea80f5b4df1 tempest-AttachVolumeShelveTestJSON-1243291534 None] No connector for attachment 021f2a6d-551c-476b-898b-49e3e3b98f2f; skipping storage backend terminate_connection call. {{(pid=86137) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 15 18:48:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-3f0fde51-bc58-4325-b757-62a0c3f3ac64 req-6be201da-e2dc-43f5-9df1-dea80f5b4df1 tempest-AttachVolumeShelveTestJSON-1243291534 None] Deleting attachment 021f2a6d-551c-476b-898b-49e3e3b98f2f. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Flow 'volume_create_manager' (8711bf5d-8d8b-4078-8a8e-e366d22cf83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2021b20-790b-4b88-9898-17a598653a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2021b20-790b-4b88-9898-17a598653a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2115831305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bf4f35-a598-45fd-9864-6d9a4cf69864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10942aaf4db4f039fc28b99ba231caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:00Z,use_quota=True,user_id='71b3d05c5c15488c9d6a9d7c788135cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5ed4a9-c72a-4185-991b-758976500ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5ed4a9-c72a-4185-991b-758976500ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8cefcd-f8b7-465a-b178-34026141b6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8cefcd-f8b7-465a-b178-34026141b6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4bf4f35-a598-45fd-9864-6d9a4cf69864', 'volume_name': 'volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b1c4cb-0fbe-415a-b2ab-83f85be1fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b1c4cb-0fbe-415a-b2ab-83f85be1fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d92439-c66a-4d79-be32-01c0a4e40c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:48:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Volume c4bf4f35-a598-45fd-9864-6d9a4cf69864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864', 'volume_size': 1} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2115831305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4bf4f35-a598-45fd-9864-6d9a4cf69864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10942aaf4db4f039fc28b99ba231caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:00Z,use_quota=True,user_id='71b3d05c5c15488c9d6a9d7c788135cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Creating volume c4bf4f35-a598-45fd-9864-6d9a4cf69864 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:48:59 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:48:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:48:59 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 1073741824 Sep 15 18:48:59 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:00 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 1073741824" returned: 0 in 0.531s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:00 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 Sep 15 18:49:00 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:00 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864" returned: 0 in 0.369s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:49:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d92439-c66a-4d79-be32-01c0a4e40c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4b5791-6779-41d7-b89e-c9b89295b257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:00 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Volume volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 (c4bf4f35-a598-45fd-9864-6d9a4cf69864): created successfully Sep 15 18:49:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d4b5791-6779-41d7-b89e-c9b89295b257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Flow 'volume_create_manager' (8711bf5d-8d8b-4078-8a8e-e366d22cf83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dc9320c1-8d6e-4ac9-bfff-3536cbacb4a0 tempest-AttachVolumeTestJSON-1572753679 None] Created volume successfully. Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Flow 'volume_create_manager' (d1f8ad66-7013-4bb6-9c17-339b2007c404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5380ec9-8ebd-4b56-8af6-db8ca17073d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5380ec9-8ebd-4b56-8af6-db8ca17073d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-233172711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d815bb2c-7f8b-4103-8110-81352e2e6b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75485f1818b14d45b8fc0802a7a98926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:03Z,use_quota=True,user_id='0dd340f4f8c046e4ad22e348f27e94fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4840221a-dd22-4395-af95-64de0085e999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4840221a-dd22-4395-af95-64de0085e999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8ab5ea-5000-42b6-a2e7-89e284bbdf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8ab5ea-5000-42b6-a2e7-89e284bbdf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd815bb2c-7f8b-4103-8110-81352e2e6b20', 'volume_name': 'volume-d815bb2c-7f8b-4103-8110-81352e2e6b20', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324cce8f-bf65-423a-87e5-172b58e7b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324cce8f-bf65-423a-87e5-172b58e7b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bf38b6-ffce-4079-b4c0-d9257ccf67d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:02 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Volume d815bb2c-7f8b-4103-8110-81352e2e6b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d815bb2c-7f8b-4103-8110-81352e2e6b20', 'volume_size': 1} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-233172711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d815bb2c-7f8b-4103-8110-81352e2e6b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75485f1818b14d45b8fc0802a7a98926',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:03Z,use_quota=True,user_id='0dd340f4f8c046e4ad22e348f27e94fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Creating volume d815bb2c-7f8b-4103-8110-81352e2e6b20 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:49:02 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:02 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 1073741824 Sep 15 18:49:02 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-401d1b9c-6f02-4490-9ad2-0d76bd88c639 req-5754d9a2-04a5-40d5-996a-78ae6aafe0e8 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:03 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 1073741824" returned: 0 in 0.536s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:03 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 Sep 15 18:49:03 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:03 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20" returned: 0 in 0.282s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-401d1b9c-6f02-4490-9ad2-0d76bd88c639 req-5754d9a2-04a5-40d5-996a-78ae6aafe0e8 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.734s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-401d1b9c-6f02-4490-9ad2-0d76bd88c639 req-5754d9a2-04a5-40d5-996a-78ae6aafe0e8 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7bf38b6-ffce-4079-b4c0-d9257ccf67d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d815bb2c-7f8b-4103-8110-81352e2e6b20', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9236079-e667-452e-abae-6cd2b7e7fc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-401d1b9c-6f02-4490-9ad2-0d76bd88c639 req-5754d9a2-04a5-40d5-996a-78ae6aafe0e8 tempest-AttachVolumeTestJSON-1572753679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ec9af15-1c30-414b-90e6-65a50dc68ba8', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:49:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Volume volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 (d815bb2c-7f8b-4103-8110-81352e2e6b20): created successfully Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9236079-e667-452e-abae-6cd2b7e7fc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Flow 'volume_create_manager' (d1f8ad66-7013-4bb6-9c17-339b2007c404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:03 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1f86e1e1-ab15-4ee3-a55f-b7ed58c58275 tempest-VolumesServicesTestJSON-1562597685 None] Created volume successfully. Sep 15 18:49:03 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-401d1b9c-6f02-4490-9ad2-0d76bd88c639 req-5754d9a2-04a5-40d5-996a-78ae6aafe0e8 tempest-AttachVolumeTestJSON-1572753679 None] attachment_update completed successfully. Sep 15 18:49:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Acquiring lock "cinder-d815bb2c-7f8b-4103-8110-81352e2e6b20-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Lock "cinder-d815bb2c-7f8b-4103-8110-81352e2e6b20-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Acquiring lock "cinder-quobyte-d815bb2c-7f8b-4103-8110-81352e2e6b20" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Lock "cinder-quobyte-d815bb2c-7f8b-4103-8110-81352e2e6b20" acquired by "delete_volume" :: waited 0.036s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed9330a-ba22-493d-93aa-bee6c019b727]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:05 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 Sep 15 18:49:05 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:05 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20" returned: 0 in 0.500s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:05 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20 Sep 15 18:49:05 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:05 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:49:06 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Flow 'volume_create_manager' (09edad81-7e1e-4bc8-9367-8cffbf901425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8a8558-3542-42fc-9c76-996087965c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d815bb2c-7f8b-4103-8110-81352e2e6b20" returned: 0 in 0.408s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8a8558-3542-42fc-9c76-996087965c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1423145601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10942aaf4db4f039fc28b99ba231caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:06Z,use_quota=True,user_id='71b3d05c5c15488c9d6a9d7c788135cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e73821d-290b-46ad-802b-e251e57b8c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e73821d-290b-46ad-802b-e251e57b8c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb3cbf2-cdc0-4e1c-9767-27ed2ed38129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb3cbf2-cdc0-4e1c-9767-27ed2ed38129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f', 'volume_name': 'volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ccfee6-6d3c-430b-a8ab-1c20c2eafabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ccfee6-6d3c-430b-a8ab-1c20c2eafabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecc806a-7275-436f-b5f6-901adff3db8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:06 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Volume 3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f', 'volume_size': 1} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1423145601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10942aaf4db4f039fc28b99ba231caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:06Z,use_quota=True,user_id='71b3d05c5c15488c9d6a9d7c788135cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Creating volume 3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:49:06 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Lock "cinder-quobyte-d815bb2c-7f8b-4103-8110-81352e2e6b20" released by "delete_volume" :: held 1.082s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:06 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f 1073741824 Sep 15 18:49:06 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Created reservations ['f426d945-6914-4f25-b8f8-be25417d92c0', 'e12d6870-22f4-4283-810b-e5cf84863843', '4d20a674-d371-4a9c-aa06-bca81aa9ab6c', '9b6e2cf0-7340-45b8-8168-746d2de6090e'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:06 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:06 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:06 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.534s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Deleted volume successfully. Sep 15 18:49:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1d75fbf3-f74b-460a-833b-36937359af38 tempest-VolumesServicesTestJSON-1562597685 None] Lock "cinder-d815bb2c-7f8b-4103-8110-81352e2e6b20-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:07 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f 1073741824" returned: 0 in 0.878s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:07 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f Sep 15 18:49:07 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:07 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f" returned: 0 in 0.527s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:49:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecc806a-7275-436f-b5f6-901adff3db8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddbc4a28-31db-4ebe-b339-809f55c83594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Volume volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f (3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f): created successfully Sep 15 18:49:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddbc4a28-31db-4ebe-b339-809f55c83594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Flow 'volume_create_manager' (09edad81-7e1e-4bc8-9367-8cffbf901425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bc7ac972-df64-4a38-8c9f-3d2e5349797b tempest-AttachVolumeTestJSON-1572753679 None] Created volume successfully. Sep 15 18:49:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d9759443-9121-490c-9760-d235a47922c9 req-fbbf4392-77b8-4fa1-ac08-24d38d503860 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d9759443-9121-490c-9760-d235a47922c9 req-fbbf4392-77b8-4fa1-ac08-24d38d503860 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d9759443-9121-490c-9760-d235a47922c9 req-fbbf4392-77b8-4fa1-ac08-24d38d503860 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-d9759443-9121-490c-9760-d235a47922c9 req-fbbf4392-77b8-4fa1-ac08-24d38d503860 tempest-AttachVolumeTestJSON-1572753679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb684af5-0b54-4049-9241-becd82aeef1a', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:49:10 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-d9759443-9121-490c-9760-d235a47922c9 req-fbbf4392-77b8-4fa1-ac08-24d38d503860 tempest-AttachVolumeTestJSON-1572753679 None] attachment_update completed successfully. Sep 15 18:49:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-1f952ff2-93bb-4db7-9106-b9375af5f09b tempest-ServerActionsTestOtherA-211200806 None] Terminate volume connection completed successfully. Sep 15 18:49:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-1f952ff2-93bb-4db7-9106-b9375af5f09b tempest-ServerActionsTestOtherA-211200806 None] Deleting attachment 4125a167-4512-4b13-b8a5-4dcd153c68d2. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "cinder-bd631729-0188-4b24-ba8c-344bca2a7fc2-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Lock "cinder-bd631729-0188-4b24-ba8c-344bca2a7fc2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "cinder-quobyte-bd631729-0188-4b24-ba8c-344bca2a7fc2" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Lock "cinder-quobyte-bd631729-0188-4b24-ba8c-344bca2a7fc2" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f96e0e-f09f-40ba-bbb4-5b9af0999a62]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:12 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 Sep 15 18:49:12 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:12 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2" returned: 0 in 0.590s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "cinder-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Lock "cinder-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:12 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2 Sep 15 18:49:12 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "cinder-quobyte-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Lock "cinder-quobyte-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45" acquired by "delete_volume" :: waited 0.046s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99b083a-f6ac-4d3c-9165-1fca2bc8e0f3]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:13 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 Sep 15 18:49:13 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:13 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-bd631729-0188-4b24-ba8c-344bca2a7fc2" returned: 0 in 0.478s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Lock "cinder-quobyte-bd631729-0188-4b24-ba8c-344bca2a7fc2" released by "delete_volume" :: held 1.159s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG cinder.quota [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Created reservations ['b2224174-c30d-4a2a-b4d1-4f5d3f4b2adc', '360966bf-8a65-4441-800a-6eaf053e72ef', '2c0305cb-5847-408e-a410-2eb122375645', 'edd60416-547d-4e35-b059-a9faa3de2110'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:13 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45" returned: 0 in 0.500s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:13 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45 Sep 15 18:49:13 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:13 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:13 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:14 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45" returned: 0 in 0.510s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:14 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.434s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG cinder.manager [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Lock "cinder-quobyte-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45" released by "delete_volume" :: held 1.079s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Deleted volume successfully. Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-b0b3624b-2e94-4723-88fb-22f23aa46e23 req-306cdc13-d046-4e0c-97cd-b53c536f5925 tempest-ServerActionsTestOtherA-211200806 None] Lock "cinder-bd631729-0188-4b24-ba8c-344bca2a7fc2-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Created reservations ['3f79db7d-5778-4a85-8000-3ff3555a3f9f', '4594ed14-720e-43b0-a767-029004a2d92d', 'd22eabcc-db51-4557-9fa4-0492f4fdc27e', '6b035635-30bf-46a1-bd42-10b2b97666c9'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:14 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:14 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-b455c0aa-8ceb-4907-8914-3b8ba188433d req-5e968a88-dc54-40e3-b4dc-1da84663f8e3 tempest-AttachVolumeTestJSON-1572753679 None] Terminate volume connection completed successfully. Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-b455c0aa-8ceb-4907-8914-3b8ba188433d req-5e968a88-dc54-40e3-b4dc-1da84663f8e3 tempest-AttachVolumeTestJSON-1572753679 None] Deleting attachment 8ec9af15-1c30-414b-90e6-65a50dc68ba8. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:49:14 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.351s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Deleted volume successfully. Sep 15 18:49:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e202f3e3-f227-4dda-ac53-5dcde823dd25 tempest-ServerActionsTestOtherA-211200806 None] Lock "cinder-e6fbc4c9-86ce-4173-b84e-9f6edccc4e45-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:16 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-d0543b03-25fb-4af1-8ce3-8ece77d36f7c req-1205c4b0-051d-46cc-9311-fe7f00e0acd6 tempest-AttachVolumeTestJSON-1572753679 None] Terminate volume connection completed successfully. Sep 15 18:49:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-d0543b03-25fb-4af1-8ce3-8ece77d36f7c req-1205c4b0-051d-46cc-9311-fe7f00e0acd6 tempest-AttachVolumeTestJSON-1572753679 None] Deleting attachment bb684af5-0b54-4049-9241-becd82aeef1a. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:49:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "cinder-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "cinder-quobyte-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-quobyte-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:24 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89dcb4f-ac22-44f9-a9ff-f49e45ab3b2d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:24 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f Sep 15 18:49:24 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:24 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f" returned: 0 in 0.462s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:24 devstack sudo[93322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f Sep 15 18:49:24 devstack sudo[93322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:25 devstack sudo[93322]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f" returned: 0 in 0.276s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-quobyte-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f" released by "delete_volume" :: held 0.803s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Created reservations ['667a8dc9-ae3c-4ac0-b6ef-d781ef3aa8d6', 'f047ec0c-a54a-451f-abfe-8e30b7d6399f', '84a1c8a7-810c-4c61-8f15-867185684443', 'c1935a7f-cb44-4535-afa3-354a8d89555c'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:25 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:25 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "cinder-c4bf4f35-a598-45fd-9864-6d9a4cf69864-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-c4bf4f35-a598-45fd-9864-6d9a4cf69864-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "cinder-quobyte-c4bf4f35-a598-45fd-9864-6d9a4cf69864" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-quobyte-c4bf4f35-a598-45fd-9864-6d9a4cf69864" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98d3f2d-d7f8-49a3-8d76-ae54c366a719]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:25 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.341s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Deleted volume successfully. Sep 15 18:49:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c2f7f8bd-1e5f-4b8a-a451-54c40eadf533 tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-3aa0ed12-4a5e-4f89-a0a1-6c03c59dac5f-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:25 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 Sep 15 18:49:25 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:26 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864" returned: 0 in 0.574s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:26 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864 Sep 15 18:49:26 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:26 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4bf4f35-a598-45fd-9864-6d9a4cf69864" returned: 0 in 0.283s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-quobyte-c4bf4f35-a598-45fd-9864-6d9a4cf69864" released by "delete_volume" :: held 0.931s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Created reservations ['7d3db022-2386-4a13-a1d1-f354346a2a2a', 'fb79490a-c505-442c-8271-14186126b04b', '26a18fc5-34c1-4556-b1d2-77a28003372b', 'aade6999-df96-472c-ac45-bc81207a873a'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:26 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:26 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:26 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.298s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:26 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Deleted volume successfully. Sep 15 18:49:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6cf8be5-e200-4488-9b4b-0f297b7ef24f tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-c4bf4f35-a598-45fd-9864-6d9a4cf69864-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "cinder-f1036d21-c08e-4b2b-8ade-2de291b3e165-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-f1036d21-c08e-4b2b-8ade-2de291b3e165-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "cinder-quobyte-f1036d21-c08e-4b2b-8ade-2de291b3e165" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-quobyte-f1036d21-c08e-4b2b-8ade-2de291b3e165" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fe0868-6b88-4bee-b00d-d1b0cf95d561]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:27 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 Sep 15 18:49:27 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:28 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165" returned: 0 in 0.400s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:28 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165 Sep 15 18:49:28 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:28 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f1036d21-c08e-4b2b-8ade-2de291b3e165" returned: 0 in 0.294s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-quobyte-f1036d21-c08e-4b2b-8ade-2de291b3e165" released by "delete_volume" :: held 0.763s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Created reservations ['e2a0853d-615a-48d4-9fef-700abd348ddc', '1ed823b0-ac7d-404a-8575-c50d40de5092', 'c9e1f571-c36c-4b73-bcc9-22219e7a9219', 'a3e53dda-ba01-4e2e-a12b-1a9522d1433e'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:28 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:28 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:29 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.481s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:29 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Deleted volume successfully. Sep 15 18:49:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-91c44945-3051-4982-8177-d0e7e449f3d2 tempest-AttachVolumeTestJSON-1572753679 None] Lock "cinder-f1036d21-c08e-4b2b-8ade-2de291b3e165-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Flow 'volume_create_manager' (e54e8b41-fdc2-4667-860d-1c8f62658125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf080fe-8808-4cab-9c5d-5cb7d8bedefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf080fe-8808-4cab-9c5d-5cb7d8bedefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-624918837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b7ac9a-b381-4433-8d98-51632f02d0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d3456cc7474a8db8e9b96a72e22e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:33Z,use_quota=True,user_id='7d77a90a77084c8bb679dc765e94d9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab90e6d-2b90-43fe-b4dd-2843f4d86511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab90e6d-2b90-43fe-b4dd-2843f4d86511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7c7aa0-22e4-4631-9841-4c6ba3f1276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a7c7aa0-22e4-4631-9841-4c6ba3f1276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b7ac9a-b381-4433-8d98-51632f02d0df', 'volume_name': 'volume-c1b7ac9a-b381-4433-8d98-51632f02d0df', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fdba3d-f8bf-4d64-bb44-4e9ecc778c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fdba3d-f8bf-4d64-bb44-4e9ecc778c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac5a94d-574c-42c3-9290-0a6d2c3aaa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:33 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Volume c1b7ac9a-b381-4433-8d98-51632f02d0df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b7ac9a-b381-4433-8d98-51632f02d0df', 'volume_size': 1} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-624918837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b7ac9a-b381-4433-8d98-51632f02d0df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8d3456cc7474a8db8e9b96a72e22e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:33Z,use_quota=True,user_id='7d77a90a77084c8bb679dc765e94d9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Creating volume c1b7ac9a-b381-4433-8d98-51632f02d0df {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:49:33 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:49:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:33 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df 1073741824 Sep 15 18:49:33 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:34 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df 1073741824" returned: 0 in 0.583s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:34 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df Sep 15 18:49:34 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:34 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df" returned: 0 in 0.322s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:49:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ac5a94d-574c-42c3-9290-0a6d2c3aaa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b7ac9a-b381-4433-8d98-51632f02d0df', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f740f3-818e-43aa-ad22-c618a864a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:34 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Volume volume-c1b7ac9a-b381-4433-8d98-51632f02d0df (c1b7ac9a-b381-4433-8d98-51632f02d0df): created successfully Sep 15 18:49:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f740f3-818e-43aa-ad22-c618a864a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Flow 'volume_create_manager' (e54e8b41-fdc2-4667-860d-1c8f62658125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:34 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c7700b92-4eb3-49ed-bbe7-60dade1ead9c tempest-AbsoluteLimitsTests-202398874 None] Created volume successfully. Sep 15 18:49:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Acquiring lock "cinder-c1b7ac9a-b381-4433-8d98-51632f02d0df-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Lock "cinder-c1b7ac9a-b381-4433-8d98-51632f02d0df-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Acquiring lock "cinder-quobyte-c1b7ac9a-b381-4433-8d98-51632f02d0df" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Lock "cinder-quobyte-c1b7ac9a-b381-4433-8d98-51632f02d0df" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:35 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[418b98b2-6c88-40f3-8cd2-4c10ded9a9e9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:36 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df Sep 15 18:49:36 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:36 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df" returned: 0 in 0.626s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:36 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df Sep 15 18:49:36 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:36 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c1b7ac9a-b381-4433-8d98-51632f02d0df" returned: 0 in 0.309s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Lock "cinder-quobyte-c1b7ac9a-b381-4433-8d98-51632f02d0df" released by "delete_volume" :: held 0.991s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Created reservations ['401c5a33-6190-4299-9e4f-f3e0c1366d4f', '69026f5a-f6a7-4001-b6b6-fc259acf7de7', 'bde6cf8c-2a92-41ae-8290-1f7bc576835f', '69ef414e-8fd5-470c-8301-cd4fddee8e7c'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:37 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:37 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:37 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.289s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Deleted volume successfully. Sep 15 18:49:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eabec2c-6bf6-4ce8-8ab5-f71c10a4049c tempest-AbsoluteLimitsTests-202398874 None] Lock "cinder-c1b7ac9a-b381-4433-8d98-51632f02d0df-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Acquiring lock "cinder-425e65e7-af27-4485-b784-cba1b6e8bf7a-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "cinder-425e65e7-af27-4485-b784-cba1b6e8bf7a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Acquiring lock "cinder-quobyte-425e65e7-af27-4485-b784-cba1b6e8bf7a" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "cinder-quobyte-425e65e7-af27-4485-b784-cba1b6e8bf7a" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:39 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f9375a-52b8-4d97-b45d-e52701013dc8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:39 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a Sep 15 18:49:39 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:40 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a" returned: 0 in 0.677s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:40 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a Sep 15 18:49:40 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:40 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-425e65e7-af27-4485-b784-cba1b6e8bf7a" returned: 0 in 0.334s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "cinder-quobyte-425e65e7-af27-4485-b784-cba1b6e8bf7a" released by "delete_volume" :: held 1.112s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Created reservations ['6ade0aab-8ff6-4c8f-bd40-c913361e6858', 'c5528155-ab7d-4660-a3ff-0df36c0a8944', 'f2726fbf-11b5-4074-8fbe-1484cc15ce37', 'eff8fef0-fe56-432a-b65d-73becffc3c35'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:40 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:40 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:40 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.336s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:41 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:41 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Deleted volume successfully. Sep 15 18:49:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5f2aee91-eb5f-41ef-893b-72ce1f369bbe tempest-AttachVolumeShelveTestJSON-1243291534 None] Lock "cinder-425e65e7-af27-4485-b784-cba1b6e8bf7a-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9312fe3-b81b-4520-a9d4-8cc1c8fa9524 tempest-BackendsCapabilitiesAdminTestsJSON-2118854097 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9375953674316, 'free_capacity_gb': 1775.9375953674316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86137) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 15 18:49:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d4133554-b0c5-46d2-8cc8-9efdd10abb50 tempest-BackendsCapabilitiesAdminTestsJSON-2118854097 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9375953674316, 'free_capacity_gb': 1775.9375953674316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86137) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 15 18:49:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:49:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:45 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:45 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:46 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.458s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:49:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 28 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:49:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Flow 'volume_create_manager' (cb676f59-3cca-4424-9e78-574171da1b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eff038f-f03b-496c-911c-2bf872e03f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eff038f-f03b-496c-911c-2bf872e03f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1727608253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614dda17-d5ff-4aaa-98d3-529a7ae14156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fcc85935c14748a9dd75f72b54dc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:50Z,use_quota=True,user_id='57622a8824f24c7ea36999fededabb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc20c45-d086-415d-8793-34267f26cac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc20c45-d086-415d-8793-34267f26cac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f974cf6-7346-49ae-bfea-b6a68c735610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f974cf6-7346-49ae-bfea-b6a68c735610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614dda17-d5ff-4aaa-98d3-529a7ae14156', 'volume_name': 'volume-614dda17-d5ff-4aaa-98d3-529a7ae14156', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5f53bb-fdab-4dd5-a88c-79414bf16f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd5f53bb-fdab-4dd5-a88c-79414bf16f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f922cae-0e87-457e-90d0-b95d9765f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:49 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Volume 614dda17-d5ff-4aaa-98d3-529a7ae14156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614dda17-d5ff-4aaa-98d3-529a7ae14156', 'volume_size': 1} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1727608253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614dda17-d5ff-4aaa-98d3-529a7ae14156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2fcc85935c14748a9dd75f72b54dc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:50Z,use_quota=True,user_id='57622a8824f24c7ea36999fededabb9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Creating volume 614dda17-d5ff-4aaa-98d3-529a7ae14156 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:49:49 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:49:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:49 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 1073741824 Sep 15 18:49:49 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:50 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 1073741824" returned: 0 in 0.774s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:50 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 Sep 15 18:49:50 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:51 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156" returned: 0 in 0.479s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:49:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f922cae-0e87-457e-90d0-b95d9765f496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614dda17-d5ff-4aaa-98d3-529a7ae14156', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47444019-f42f-4611-a2ba-758b60effb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Volume volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 (614dda17-d5ff-4aaa-98d3-529a7ae14156): created successfully Sep 15 18:49:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47444019-f42f-4611-a2ba-758b60effb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Flow 'volume_create_manager' (cb676f59-3cca-4424-9e78-574171da1b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-944bd231-8a7e-4511-bdf1-e18e44d9f18d tempest-VolumesMetadataTest-162375501 None] Created volume successfully. Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Flow 'volume_create_manager' (d04e51b9-34a8-4295-b0e0-ca8d75ad4b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0773bf-cd34-4a0a-936e-633d15ce35db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-376a1ee7-682c-4e33-970c-1deee8fffea1 tempest-GroupsV314Test-1164048941 None] Group tempest-GroupsV314Test-Group-1965485562: creating Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0773bf-cd34-4a0a-936e-633d15ce35db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1174007078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb19fe5-f84a-401f-95da-a2b5caf4f44a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a13578e25cfa4f8d8af57853de4b517b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:52Z,use_quota=True,user_id='fb53dd5b4e5c46209a07cb6c958c79d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64716dd8-8c2f-41bb-bdcb-f932fd88d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64716dd8-8c2f-41bb-bdcb-f932fd88d99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f537c759-fc19-49c9-b200-1e54cff0bd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f537c759-fc19-49c9-b200-1e54cff0bd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb19fe5-f84a-401f-95da-a2b5caf4f44a', 'volume_name': 'volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c428e9b2-a53f-42bf-bc73-dccd4ef4cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c428e9b2-a53f-42bf-bc73-dccd4ef4cd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adb858c-19d2-4089-8292-f2b2834450ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:52 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Volume 9fb19fe5-f84a-401f-95da-a2b5caf4f44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a', 'volume_size': 1} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1174007078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb19fe5-f84a-401f-95da-a2b5caf4f44a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a13578e25cfa4f8d8af57853de4b517b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:52Z,use_quota=True,user_id='fb53dd5b4e5c46209a07cb6c958c79d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Creating volume 9fb19fe5-f84a-401f-95da-a2b5caf4f44a {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:49:52 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:52 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a 1073741824 Sep 15 18:49:52 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-376a1ee7-682c-4e33-970c-1deee8fffea1 tempest-GroupsV314Test-1164048941 None] Group tempest-GroupsV314Test-Group-1965485562: created successfully Sep 15 18:49:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-376a1ee7-682c-4e33-970c-1deee8fffea1 tempest-GroupsV314Test-1164048941 None] Create group completed successfully. Sep 15 18:49:52 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a 1073741824" returned: 0 in 0.578s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:52 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a Sep 15 18:49:52 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Acquiring lock "cinder-614dda17-d5ff-4aaa-98d3-529a7ae14156-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Lock "cinder-614dda17-d5ff-4aaa-98d3-529a7ae14156-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Acquiring lock "cinder-quobyte-614dda17-d5ff-4aaa-98d3-529a7ae14156" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Lock "cinder-quobyte-614dda17-d5ff-4aaa-98d3-529a7ae14156" acquired by "delete_volume" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37cb888-56d8-4f0d-896e-6f6805a275f2]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:53 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a" returned: 0 in 0.433s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:53 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 Sep 15 18:49:53 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=73,cinder:UPDATE=81,cinder:DELETE=7,cinder:INSERT=23 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0adb858c-19d2-4089-8292-f2b2834450ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2afda18-a22b-4155-884d-d9ad784d22cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=71,cinder:INSERT=15,cinder:UPDATE=92,cinder:DELETE=6 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:49:53 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Volume volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a (9fb19fe5-f84a-401f-95da-a2b5caf4f44a): created successfully Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2afda18-a22b-4155-884d-d9ad784d22cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Flow 'volume_create_manager' (d04e51b9-34a8-4295-b0e0-ca8d75ad4b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:53 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-1e4b5030-5680-4c0a-ae73-6d532a4680e9 req-f84f6fbd-1c6d-4e01-a685-5d2c48facc99 tempest-VolumesGetTestJSON-757009632 None] Created volume successfully. Sep 15 18:49:53 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156" returned: 0 in 0.538s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:53 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156 Sep 15 18:49:53 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:54 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-614dda17-d5ff-4aaa-98d3-529a7ae14156" returned: 0 in 0.640s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Lock "cinder-quobyte-614dda17-d5ff-4aaa-98d3-529a7ae14156" released by "delete_volume" :: held 1.329s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Flow 'volume_create_manager' (becfec45-a805-41ba-9e36-75ea7e1945e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba0640d-e210-4a31-912d-b43863382c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba0640d-e210-4a31-912d-b43863382c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-187475371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55d374bc-5627-4fbf-be65-a6a0b2c70420,host='devstack@QuobyteHD#QuobyteHD',id=1c46cc14-6cd8-4308-a1df-69573cb07a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c62c3126344756a96e293ebc8cd771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:54Z,use_quota=True,user_id='b100ce4e9f514a71ae031501e251de71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e907e24-3b3b-4441-8fba-d7794d8b2771),volume_type_id=3e907e24-3b3b-4441-8fba-d7794d8b2771)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c6e140-1f44-499a-a49a-dc24c64329dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7c6e140-1f44-499a-a49a-dc24c64329dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f878315a-179b-4447-a220-2fe9e1a40cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f878315a-179b-4447-a220-2fe9e1a40cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c46cc14-6cd8-4308-a1df-69573cb07a66', 'volume_name': 'volume-1c46cc14-6cd8-4308-a1df-69573cb07a66', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30971bdb-b441-40c7-a9e4-c12d1dffa695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30971bdb-b441-40c7-a9e4-c12d1dffa695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d939c4-4a38-44d5-a29a-ca1a8728074b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:54 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Volume 1c46cc14-6cd8-4308-a1df-69573cb07a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c46cc14-6cd8-4308-a1df-69573cb07a66', 'volume_size': 1} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55d374bc-5627-4fbf-be65-a6a0b2c70420,created_at=2026-09-15T16:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-187475371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55d374bc-5627-4fbf-be65-a6a0b2c70420,host='devstack@QuobyteHD#QuobyteHD',id=1c46cc14-6cd8-4308-a1df-69573cb07a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3c62c3126344756a96e293ebc8cd771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:49:54Z,use_quota=True,user_id='b100ce4e9f514a71ae031501e251de71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e907e24-3b3b-4441-8fba-d7794d8b2771),volume_type_id=3e907e24-3b3b-4441-8fba-d7794d8b2771)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Creating volume 1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:49:54 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:54 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 1073741824 Sep 15 18:49:54 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Created reservations ['6255212c-08a2-4e5b-a4a0-09691107001f', 'bb58cd57-9626-41b9-b2ef-e6e7fe738b1d', '48707df6-3a61-4190-9723-1e8e9d76f868', '8ba4a58d-55ef-4dce-be65-5af13aaaf665'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:54 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:54 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Acquiring lock "cinder-9fb19fe5-f84a-401f-95da-a2b5caf4f44a-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Lock "cinder-9fb19fe5-f84a-401f-95da-a2b5caf4f44a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Acquiring lock "cinder-quobyte-9fb19fe5-f84a-401f-95da-a2b5caf4f44a" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Lock "cinder-quobyte-9fb19fe5-f84a-401f-95da-a2b5caf4f44a" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c30254-2ce2-4ba2-b957-46fcabd1b83c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:55 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.525s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Deleted volume successfully. Sep 15 18:49:55 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 1073741824" returned: 0 in 0.819s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:55 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a Sep 15 18:49:55 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-65447629-498b-4a7d-8ef2-264bfe5e5638 tempest-VolumesMetadataTest-162375501 None] Lock "cinder-614dda17-d5ff-4aaa-98d3-529a7ae14156-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:55 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 Sep 15 18:49:55 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:55 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66" returned: 0 in 0.518s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d939c4-4a38-44d5-a29a-ca1a8728074b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c46cc14-6cd8-4308-a1df-69573cb07a66', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dabfb9-f495-48d9-ae21-d4db17b90bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:49:56 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a" returned: 0 in 0.809s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:56 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Volume volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 (1c46cc14-6cd8-4308-a1df-69573cb07a66): created successfully Sep 15 18:49:56 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a Sep 15 18:49:56 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50dabfb9-f495-48d9-ae21-d4db17b90bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Flow 'volume_create_manager' (becfec45-a805-41ba-9e36-75ea7e1945e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:49:56 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6dd023ab-6abe-48f9-8930-3d27d80d067b tempest-GroupsV314Test-1164048941 None] Created volume successfully. Sep 15 18:49:56 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9fb19fe5-f84a-401f-95da-a2b5caf4f44a" returned: 0 in 0.398s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Lock "cinder-quobyte-9fb19fe5-f84a-401f-95da-a2b5caf4f44a" released by "delete_volume" :: held 1.275s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.quota [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Created reservations ['c0883719-daf1-446a-8c05-da8553ae238d', 'd005e8a4-d08a-4f29-9543-2c5983188e2b', '37563658-d84f-4956-96d3-541bf5388a73', '1e135944-3790-4aaf-b565-c4c6d1eb05bb'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:56 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:49:56 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:56 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.manager [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:49:56 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Deleted volume successfully. Sep 15 18:49:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-e4c10dd4-b793-47b7-a6ff-f5faef9d4afd req-3b5a6823-2dad-4766-8c13-b1de2d3ca037 tempest-VolumesGetTestJSON-757009632 None] Lock "cinder-9fb19fe5-f84a-401f-95da-a2b5caf4f44a-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:49:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:49:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:49:58 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Cloning volume 1c46cc14-6cd8-4308-a1df-69573cb07a66 to volume 3c190996-3ae7-48f9-924a-b439bda4dc42 Sep 15 18:49:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Creating offline snapshot f4aa2999-c053-4208-8306-e91c8de7097b of volume 1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:49:58 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ebb855-4502-46be-ab65-314514256470]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:49:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:58 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 Sep 15 18:49:58 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:58 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66" returned: 0 in 0.653s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:59 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b 1G Sep 15 18:49:59 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:49:59 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Sep 15 18:49:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b 1G" returned: 0 in 0.884s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:49:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:49:59 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b Sep 15 18:49:59 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:00 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b" returned: 0 in 0.555s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:00 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:50:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:00 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b Sep 15 18:50:00 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:00 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b" returned: 0 in 0.323s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:00 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.info Sep 15 18:50:00 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:01 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.info" returned: 0 in 0.437s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:01 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:01 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.info Sep 15 18:50:01 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:01 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.info" returned: 0 in 0.319s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Acquiring lock "cinder-quobyte-3c190996-3ae7-48f9-924a-b439bda4dc42" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Lock "cinder-quobyte-3c190996-3ae7-48f9-924a-b439bda4dc42" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] snapshot: f4aa2999-c053-4208-8306-e91c8de7097b, volume: 3c190996-3ae7-48f9-924a-b439bda4dc42, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf644cb9-bfa1-4d89-8973-c08f4da4bfad]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:01 devstack sudo[93638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b Sep 15 18:50:01 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:02 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b" returned: 0 in 0.489s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c46cc14-6cd8-4308-a1df-69573cb07a66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:50:02 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c8ea0c-278a-4983-9220-f9950f4e0e34]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:02 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 Sep 15 18:50:02 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:02 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66" returned: 0 in 0.561s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 18:50:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 18:50:02 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 18:50:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:02 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 Sep 15 18:50:02 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:03 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:50:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Flow 'volume_create_manager' (363b6339-cbd1-41f1-95e8-cc84b18a8e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b0ffb-d239-4137-9fa0-bbac03a200b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4b0ffb-d239-4137-9fa0-bbac03a200b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-163349592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c1e392-c57a-4849-9be8-a1c91147af6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae52ddd667054684979ce1aa76e135dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:03Z,use_quota=True,user_id='4ce8f535da6d4adeaa4a85c61770cdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c27f870-f2c5-4337-a621-59da619e8119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c27f870-f2c5-4337-a621-59da619e8119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127a5819-1ff3-4784-a02e-de569f1b1f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:03 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 18:50:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127a5819-1ff3-4784-a02e-de569f1b1f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '87c1e392-c57a-4849-9be8-a1c91147af6c', 'volume_name': 'volume-87c1e392-c57a-4849-9be8-a1c91147af6c', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503f3aba-1527-48bc-a113-859c89426b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503f3aba-1527-48bc-a113-859c89426b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376bdd9f-a076-4983-848b-fa37cd346685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Volume 87c1e392-c57a-4849-9be8-a1c91147af6c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-87c1e392-c57a-4849-9be8-a1c91147af6c', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 18:50:04 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Trying to clone 87c1e392-c57a-4849-9be8-a1c91147af6c from image cb9e9155-abe1-4ceb-8a92-39c0a579534a at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 18:50:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dc9f78ff-ac09-456d-9444-6487b4f68afa tempest-GroupsV320Test-1811750774 None] Group tempest-GroupsV320Test-Group-1534390926: creating Sep 15 18:50:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dc9f78ff-ac09-456d-9444-6487b4f68afa tempest-GroupsV320Test-1811750774 None] Group tempest-GroupsV320Test-Group-1534390926: created successfully Sep 15 18:50:06 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD, size 20.69 MB, duration 1.27 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 18:50:06 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Image download 20.69 MB at 16.30 MB/s Sep 15 18:50:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dc9f78ff-ac09-456d-9444-6487b4f68afa tempest-GroupsV320Test-1811750774 None] Create group completed successfully. Sep 15 18:50:06 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[28988c5f-eb0a-4e6d-beca-867f204613ad]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:06 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD Sep 15 18:50:06 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:07 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD" returned: 0 in 0.903s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:07 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a is fetched for user 4ce8f535da6d4adeaa4a85c61770cdeb. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 18:50:07 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e125de68-47df-4a5b-834c-ee55978b72c8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:07 devstack sudo[93668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD Sep 15 18:50:07 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:07 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:07 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] Created reservations ['4d285e09-546d-4125-8125-d68c5a8492a8'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:08 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:50:08 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:08 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.632s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:08 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:50:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3d8a2a14-e356-4751-b675-a044c0886731 tempest-GroupsV320Test-1811750774 None] Delete group completed successfully. Sep 15 18:50:11 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42" returned: 0 in 9.042s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:11 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:50:11 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Converted 1024.00 MB image at 113.24 MB/s Sep 15 18:50:11 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:50:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:11 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 Sep 15 18:50:11 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:12 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42" returned: 0 in 0.271s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Lock "cinder-quobyte-3c190996-3ae7-48f9-924a-b439bda4dc42" released by "_copy_volume_from_snapshot" :: held 10.471s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Acquiring lock "cinder-quobyte-f4aa2999-c053-4208-8306-e91c8de7097b" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Lock "cinder-quobyte-f4aa2999-c053-4208-8306-e91c8de7097b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Deleting offline snapshot f4aa2999-c053-4208-8306-e91c8de7097b of volume 1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] snapshot_file for this snap is: volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82e1fdf-fb0d-455a-bea9-1a7b59fd6228]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:12 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b Sep 15 18:50:12 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:12 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b" returned: 0 in 0.383s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c46cc14-6cd8-4308-a1df-69573cb07a66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a0544-b3eb-40e5-a355-249622a66f13]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:12 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 Sep 15 18:50:12 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:13 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66" returned: 0 in 0.544s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:13 devstack sudo[93711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b Sep 15 18:50:13 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:13 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b" returned: 0 in 0.376s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:13 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b Sep 15 18:50:13 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:13 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66.f4aa2999-c053-4208-8306-e91c8de7097b" returned: 0 in 0.244s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Lock "cinder-quobyte-f4aa2999-c053-4208-8306-e91c8de7097b" released by "_delete_snapshot" :: held 1.670s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.623s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.898s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-163349592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c1e392-c57a-4849-9be8-a1c91147af6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae52ddd667054684979ce1aa76e135dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:03Z,use_quota=True,user_id='4ce8f535da6d4adeaa4a85c61770cdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Creating volume 87c1e392-c57a-4849-9be8-a1c91147af6c {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:50:13 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:50:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:13 devstack sudo[93720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c 1073741824 Sep 15 18:50:13 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:13 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-072306f7-a5d6-4116-8718-1bb976875c3a tempest-GroupsV314Test-1164048941 None] Create group from source-group-55d374bc-5627-4fbf-be65-a6a0b2c70420 completed successfully. Sep 15 18:50:14 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c 1073741824" returned: 0 in 0.466s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:14 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c Sep 15 18:50:14 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:14 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c" returned: 0 in 0.249s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:50:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:14 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Attempting download of cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume 87c1e392-c57a-4849-9be8-a1c91147af6c. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 18:50:14 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c92c13-203d-452a-aed0-4b561f8c586b]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_ju5heisb {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:14 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_ju5heisb Sep 15 18:50:14 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Acquiring lock "cinder-quobyte-3c190996-3ae7-48f9-924a-b439bda4dc42" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Lock "cinder-quobyte-3c190996-3ae7-48f9-924a-b439bda4dc42" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:15 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_ju5heisb" returned: 0 in 0.396s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_ju5heisb {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f6f481-2176-4131-9125-621f53167a5d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:15 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_ju5heisb Sep 15 18:50:15 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:15 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 Sep 15 18:50:15 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:15 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_ju5heisb" returned: 1 in 0.426s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_ju5heisb' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7eb754-04cd-46bf-8a7d-310a79f3ecc1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:15 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42" returned: 0 in 0.514s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:15 devstack sudo[93745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD Sep 15 18:50:15 devstack sudo[93745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:15 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42 Sep 15 18:50:15 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:15 devstack sudo[93745]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] cb9e9155-abe1-4ceb-8a92-39c0a579534a was qcow2, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:15 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c Sep 15 18:50:15 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:15 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3c190996-3ae7-48f9-924a-b439bda4dc42" returned: 0 in 0.349s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Lock "cinder-quobyte-3c190996-3ae7-48f9-924a-b439bda4dc42" released by "delete_volume" :: held 0.941s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Created reservations ['32b29c7e-af12-4701-ad83-cca9b6101f84'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:16 devstack cinder-volume[86137]: WARNING cinder.quota [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-872954941 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-872954941, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:50:16 devstack cinder-volume[86137]: WARNING cinder.quota [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-872954941 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-872954941, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Created reservations ['9b2a011d-b923-4bad-9730-0de19d80f042', 'b2b94ef8-692e-492a-966c-a2c8b61325e3', '67347727-a59f-4684-b305-467899905820', '5f21f65c-342a-46ef-acf5-01b68a43b289'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:16 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:50:16 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:16 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.346s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:16 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:50:16 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-55af3000-227e-4b21-ae92-d1fb7a88f773 tempest-GroupsV314Test-1164048941 None] Delete group completed successfully. Sep 15 18:50:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Acquiring lock "cinder-quobyte-1c46cc14-6cd8-4308-a1df-69573cb07a66" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Lock "cinder-quobyte-1c46cc14-6cd8-4308-a1df-69573cb07a66" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:17 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8caf4ea-2f3e-4d47-8c07-9d38c807977e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:17 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 Sep 15 18:50:17 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:18 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66" returned: 0 in 0.475s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:18 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66 Sep 15 18:50:18 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:18 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c" returned: 0 in 2.557s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_3h__eu44devstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:50:18 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Converted 112.00 MB image at 43.78 MB/s Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:18 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c 1G Sep 15 18:50:18 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:18 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1c46cc14-6cd8-4308-a1df-69573cb07a66" returned: 0 in 0.276s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Lock "cinder-quobyte-1c46cc14-6cd8-4308-a1df-69573cb07a66" released by "delete_volume" :: held 0.833s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Created reservations ['6d6bd15f-eae8-4b52-9aa7-1aa70b9f4ada'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Created reservations ['f349bf90-a5f7-47f4-a805-664e2e25ae68', '3a3a35a7-61d7-4423-86d6-b30aabc00a7b', '54472687-2d74-4358-b95a-24b73391bc50', '543e5920-7106-4ff7-9412-fb6642864074'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:18 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c 1G" returned: 0 in 0.396s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Downloaded image cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume 87c1e392-c57a-4849-9be8-a1c91147af6c successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a for user 4ce8f535da6d4adeaa4a85c61770cdeb is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Marking volume 87c1e392-c57a-4849-9be8-a1c91147af6c as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 18:50:18 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:50:18 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Copying metadata from image cb9e9155-abe1-4ceb-8a92-39c0a579534a to 87c1e392-c57a-4849-9be8-a1c91147af6c. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Creating volume glance metadata for volume 87c1e392-c57a-4849-9be8-a1c91147af6c backed by image cb9e9155-abe1-4ceb-8a92-39c0a579534a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376bdd9f-a076-4983-848b-fa37cd346685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c1e392-c57a-4849-9be8-a1c91147af6c', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed37e98f-6aa8-4243-9a4d-1b08a5a3743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:18 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Volume volume-87c1e392-c57a-4849-9be8-a1c91147af6c (87c1e392-c57a-4849-9be8-a1c91147af6c): created successfully Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed37e98f-6aa8-4243-9a4d-1b08a5a3743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Flow 'volume_create_manager' (363b6339-cbd1-41f1-95e8-cc84b18a8e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:18 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-2a9c562f-5c74-46ee-9eaa-9414afccc52a tempest-VolumesExtendTest-1904464373 None] Created volume successfully. Sep 15 18:50:19 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.290s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:19 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:50:19 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e43ece9c-fca3-49ec-a398-df9a3df70495 tempest-GroupsV314Test-1164048941 None] Delete group completed successfully. Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-734999c5-c8b3-4741-8154-5f78ec8bdf28 tempest-VolumesExtendTest-1904464373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-734999c5-c8b3-4741-8154-5f78ec8bdf28 tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75fe0af-6e8f-4b78-a70d-83d1e1388a80]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-734999c5-c8b3-4741-8154-5f78ec8bdf28 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:20 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c Sep 15 18:50:20 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Flow 'volume_create_manager' (a681bb44-c3a2-4f96-ada4-49d385ae2d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ac72f1-f0f9-4c08-8f5c-47b413afb322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ac72f1-f0f9-4c08-8f5c-47b413afb322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881465653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1a9a17-7933-48ce-ae73-4fc8c0137092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927977e5d9904441855219a128b033f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:21Z,use_quota=True,user_id='8949a22e45784d3b8fb57bf337e75280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa1151a-3799-4a6d-b247-ca05de9ce2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa1151a-3799-4a6d-b247-ca05de9ce2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c7be3a-fa8e-41fc-8506-6ad295aebeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1c7be3a-fa8e-41fc-8506-6ad295aebeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1a9a17-7933-48ce-ae73-4fc8c0137092', 'volume_name': 'volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6979d528-1d5f-4e78-bcbf-cd38d56f5cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6979d528-1d5f-4e78-bcbf-cd38d56f5cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a693487-a1a1-419e-89aa-f41677c8784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:20 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Volume ea1a9a17-7933-48ce-ae73-4fc8c0137092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092', 'volume_size': 1} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:20 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-734999c5-c8b3-4741-8154-5f78ec8bdf28 tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c" returned: 0 in 0.520s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-734999c5-c8b3-4741-8154-5f78ec8bdf28 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c 2G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-734999c5-c8b3-4741-8154-5f78ec8bdf28 tempest-VolumesExtendTest-1904464373 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c 2G" returned: 0 in 0.120s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-734999c5-c8b3-4741-8154-5f78ec8bdf28 tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.671s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.185s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881465653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1a9a17-7933-48ce-ae73-4fc8c0137092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927977e5d9904441855219a128b033f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:21Z,use_quota=True,user_id='8949a22e45784d3b8fb57bf337e75280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Creating volume ea1a9a17-7933-48ce-ae73-4fc8c0137092 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:50:20 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:50:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:20 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 1073741824 Sep 15 18:50:20 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:21 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-734999c5-c8b3-4741-8154-5f78ec8bdf28 tempest-VolumesExtendTest-1904464373 None] Extend volume completed successfully. Sep 15 18:50:21 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 1073741824" returned: 0 in 0.669s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:21 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 Sep 15 18:50:21 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:21 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Acquiring lock "cinder-87c1e392-c57a-4849-9be8-a1c91147af6c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a693487-a1a1-419e-89aa-f41677c8784c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76768d26-62ff-4634-896e-56b4d3c7687c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Lock "cinder-87c1e392-c57a-4849-9be8-a1c91147af6c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:22 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Volume volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 (ea1a9a17-7933-48ce-ae73-4fc8c0137092): created successfully Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76768d26-62ff-4634-896e-56b4d3c7687c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Flow 'volume_create_manager' (a681bb44-c3a2-4f96-ada4-49d385ae2d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:22 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-17e387a3-be50-46cf-9df9-94dbf10be3b9 tempest-AttachVolumeNegativeTest-522311683 None] Created volume successfully. Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Acquiring lock "cinder-quobyte-87c1e392-c57a-4849-9be8-a1c91147af6c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Lock "cinder-quobyte-87c1e392-c57a-4849-9be8-a1c91147af6c" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dbdcf1-ca96-436c-a1da-a941b414cd5e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:22 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c Sep 15 18:50:22 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:22 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c" returned: 0 in 0.474s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:22 devstack sudo[93812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c Sep 15 18:50:22 devstack sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:23 devstack sudo[93812]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-87c1e392-c57a-4849-9be8-a1c91147af6c" returned: 0 in 0.318s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Lock "cinder-quobyte-87c1e392-c57a-4849-9be8-a1c91147af6c" released by "delete_volume" :: held 0.858s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Created reservations ['d513dbca-c640-4570-a5a7-5238b04da53a', '0305a30d-2ef2-44fb-b834-751937665f70', '9da2f087-bfca-4d86-815d-c4751e75b8eb', '4e52525a-de98-453b-90ae-77224b16b0c2'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:23 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:50:23 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-27be5db7-984c-4602-a3e7-548b2db7fa8e req-4d167ca7-466b-4ab0-95db-54a245ba58d3 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-27be5db7-984c-4602-a3e7-548b2db7fa8e req-4d167ca7-466b-4ab0-95db-54a245ba58d3 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:23 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.306s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:50:23 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Deleted volume successfully. Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-27be5db7-984c-4602-a3e7-548b2db7fa8e req-4d167ca7-466b-4ab0-95db-54a245ba58d3 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c3618c1b-e6bb-40b5-af5e-eb110078076c tempest-VolumesExtendTest-1904464373 None] Lock "cinder-87c1e392-c57a-4849-9be8-a1c91147af6c-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:23 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-27be5db7-984c-4602-a3e7-548b2db7fa8e req-4d167ca7-466b-4ab0-95db-54a245ba58d3 tempest-AttachVolumeNegativeTest-522311683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '849876cb-96e6-4dfb-8e6e-a02d626a7240', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:50:23 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-27be5db7-984c-4602-a3e7-548b2db7fa8e req-4d167ca7-466b-4ab0-95db-54a245ba58d3 tempest-AttachVolumeNegativeTest-522311683 None] attachment_update completed successfully. Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Flow 'volume_create_manager' (e803387e-acfc-4107-9658-e31ff9271695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aed94f9-71f5-4fac-83be-544ef762df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aed94f9-71f5-4fac-83be-544ef762df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1554582780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b966fc26-63b4-4cd4-80c9-7c1730a58ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae52ddd667054684979ce1aa76e135dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:25Z,use_quota=True,user_id='4ce8f535da6d4adeaa4a85c61770cdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fdfe48-f521-48d9-9b68-9408652d5286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fdfe48-f521-48d9-9b68-9408652d5286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2736794b-86bb-4b0c-bec4-fbddebae7c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2736794b-86bb-4b0c-bec4-fbddebae7c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b966fc26-63b4-4cd4-80c9-7c1730a58ba8', 'volume_name': 'volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaadf4b-6939-4140-9da4-35e0cc9400d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efaadf4b-6939-4140-9da4-35e0cc9400d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc450c6b-da81-4dac-bb3b-c5bad968602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:25 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Volume b966fc26-63b4-4cd4-80c9-7c1730a58ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8', 'volume_size': 1} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1554582780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b966fc26-63b4-4cd4-80c9-7c1730a58ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae52ddd667054684979ce1aa76e135dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:25Z,use_quota=True,user_id='4ce8f535da6d4adeaa4a85c61770cdeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Creating volume b966fc26-63b4-4cd4-80c9-7c1730a58ba8 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:50:25 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:25 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 1073741824 Sep 15 18:50:25 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:25 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 1073741824" returned: 0 in 0.517s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:25 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 Sep 15 18:50:25 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:25 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" returned: 0 in 0.299s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc450c6b-da81-4dac-bb3b-c5bad968602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5872748e-82ee-4adb-a5ba-1d443e3cffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:25 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Volume volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 (b966fc26-63b4-4cd4-80c9-7c1730a58ba8): created successfully Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5872748e-82ee-4adb-a5ba-1d443e3cffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Flow 'volume_create_manager' (e803387e-acfc-4107-9658-e31ff9271695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1122a05e-2484-4324-8b6e-94f9ac8a4e99 tempest-VolumesExtendTest-1904464373 None] Created volume successfully. Sep 15 18:50:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Creating offline snapshot 4ba612af-d1d7-4bd6-a808-14ce4229c6fc of volume b966fc26-63b4-4cd4-80c9-7c1730a58ba8 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:50:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a48de5a-050d-461d-8780-10fe921d73f6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:27 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 Sep 15 18:50:27 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:27 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:50:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Flow 'volume_create_manager' (3c46d6b1-0220-47f9-986b-c5a6303d8f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2710e1-6c72-4067-876c-f77a8e08be25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2710e1-6c72-4067-876c-f77a8e08be25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-247992227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b1d540-010e-4a06-8a71-a63718fbfae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be5f873e574c82ab44b6003c69df6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:28Z,use_quota=True,user_id='e79c27d46de347ceb6b623f155ea21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff855611-11cf-4de4-8e56-56e321c4687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff855611-11cf-4de4-8e56-56e321c4687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9242c4e9-26f6-414f-b24d-a1f5bdce5809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9242c4e9-26f6-414f-b24d-a1f5bdce5809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b1d540-010e-4a06-8a71-a63718fbfae7', 'volume_name': 'volume-39b1d540-010e-4a06-8a71-a63718fbfae7', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6df1c49-234d-48ae-afd1-39fcfc7efdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6df1c49-234d-48ae-afd1-39fcfc7efdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fab15b-27f2-4663-8123-0e9251fd82dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:28 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Volume 39b1d540-010e-4a06-8a71-a63718fbfae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b1d540-010e-4a06-8a71-a63718fbfae7', 'volume_size': 1} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:28 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" returned: 0 in 0.520s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:28 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc 1G Sep 15 18:50:28 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:28 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc 1G" returned: 0 in 0.559s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:28 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc Sep 15 18:50:28 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:29 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc" returned: 0 in 0.363s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:29 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc is being set with open permissions: ugo+rw Sep 15 18:50:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:29 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc Sep 15 18:50:29 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:29 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc" returned: 0 in 0.323s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:29 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.info Sep 15 18:50:29 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:29 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.info" returned: 0 in 0.316s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:29 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.info is being set with open permissions: ugo+rw Sep 15 18:50:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:29 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.info Sep 15 18:50:29 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:30 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.info" returned: 0 in 0.348s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.581s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.072s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-247992227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b1d540-010e-4a06-8a71-a63718fbfae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be5f873e574c82ab44b6003c69df6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:28Z,use_quota=True,user_id='e79c27d46de347ceb6b623f155ea21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Creating volume 39b1d540-010e-4a06-8a71-a63718fbfae7 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:50:30 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:30 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7 1073741824 Sep 15 18:50:30 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:30 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-22f4d5b3-10b7-4b7e-a207-e0a3a273a30e tempest-VolumesExtendTest-1904464373 None] Create snapshot completed successfully Sep 15 18:50:30 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7 1073741824" returned: 0 in 0.707s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-890a5f99-c38b-4512-b496-2694a3bce40a tempest-VolumesExtendTest-1904464373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:30 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7 Sep 15 18:50:30 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:31 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7" returned: 0 in 0.302s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-890a5f99-c38b-4512-b496-2694a3bce40a tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.329s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fab15b-27f2-4663-8123-0e9251fd82dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b1d540-010e-4a06-8a71-a63718fbfae7', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c95748e-741d-41c4-a53f-72ae162dbade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d992e3f-fae2-4dda-b15d-3e94787ee137]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-890a5f99-c38b-4512-b496-2694a3bce40a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:31 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Volume volume-39b1d540-010e-4a06-8a71-a63718fbfae7 (39b1d540-010e-4a06-8a71-a63718fbfae7): created successfully Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c95748e-741d-41c4-a53f-72ae162dbade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Flow 'volume_create_manager' (3c46d6b1-0220-47f9-986b-c5a6303d8f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-44e3a989-712b-4c8a-90f1-4a37db59d327 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Created volume successfully. Sep 15 18:50:31 devstack sudo[94331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 Sep 15 18:50:31 devstack sudo[94331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:31 devstack sudo[94331]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-890a5f99-c38b-4512-b496-2694a3bce40a tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" returned: 0 in 0.484s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-890a5f99-c38b-4512-b496-2694a3bce40a tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc 2G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-890a5f99-c38b-4512-b496-2694a3bce40a tempest-VolumesExtendTest-1904464373 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc 2G" returned: 0 in 0.227s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-890a5f99-c38b-4512-b496-2694a3bce40a tempest-VolumesExtendTest-1904464373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.771s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:32 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-890a5f99-c38b-4512-b496-2694a3bce40a tempest-VolumesExtendTest-1904464373 None] Extend volume completed successfully. Sep 15 18:50:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Acquiring lock "cinder-39b1d540-010e-4a06-8a71-a63718fbfae7-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "cinder-39b1d540-010e-4a06-8a71-a63718fbfae7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Acquiring lock "cinder-quobyte-39b1d540-010e-4a06-8a71-a63718fbfae7" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "cinder-quobyte-39b1d540-010e-4a06-8a71-a63718fbfae7" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:32 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a51d0af-d420-4d30-8d3b-e358fe13602f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:32 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7 Sep 15 18:50:32 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:32 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7" returned: 0 in 0.401s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:33 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7 Sep 15 18:50:33 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Acquiring lock "cinder-4ba612af-d1d7-4bd6-a808-14ce4229c6fc-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-4ba612af-d1d7-4bd6-a808-14ce4229c6fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:33 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Acquiring lock "cinder-quobyte-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b1d540-010e-4a06-8a71-a63718fbfae7" returned: 0 in 0.427s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "cinder-quobyte-39b1d540-010e-4a06-8a71-a63718fbfae7" released by "delete_volume" :: held 0.888s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-quobyte-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Acquiring lock "cinder-quobyte-4ba612af-d1d7-4bd6-a808-14ce4229c6fc" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-quobyte-4ba612af-d1d7-4bd6-a808-14ce4229c6fc" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Deleting offline snapshot 4ba612af-d1d7-4bd6-a808-14ce4229c6fc of volume b966fc26-63b4-4cd4-80c9-7c1730a58ba8 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] snapshot_file for this snap is: volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb39016-e119-4f03-97df-0628810d5f93]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Created reservations ['7ed518a9-dd29-4f72-b422-6036c7dc6e66', '440e022b-9943-4e41-a3b5-7d1f00bedc1e', '8a4f739b-f04b-4fec-a92f-3ed3769d0571', '15b39abf-9514-46dd-83ed-42958bfb2c94'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:33 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc Sep 15 18:50:33 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:33 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:50:33 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:34 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.333s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:50:34 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Deleted volume successfully. Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a79c84f8-67c9-4a91-a1e7-6a7a44ddc9ce tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "cinder-39b1d540-010e-4a06-8a71-a63718fbfae7-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:34 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc" returned: 0 in 0.669s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29a6f66-0bcb-4226-9eb9-3fb9c89a122e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:34 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 Sep 15 18:50:34 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Flow 'volume_create_manager' (bb00d547-0492-4c13-aca6-3475be794a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:34 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940112b6-76dc-49e2-93ac-ed5ec443483d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" returned: 0 in 0.800s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940112b6-76dc-49e2-93ac-ed5ec443483d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-27261243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9a2a91-386d-47c2-aa3e-a63e4730ff41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6751d8ad5b254d24a3744a48ea2464e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:35Z,use_quota=True,user_id='a32a8b837a4140319a1fa9a404d88b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a74fde8-ddff-4be2-930e-b9e63c1917f0),volume_type_id=9a74fde8-ddff-4be2-930e-b9e63c1917f0)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8d6b34-2e00-4963-922d-dd04bae99473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc Sep 15 18:50:35 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8d6b34-2e00-4963-922d-dd04bae99473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4ae740-9e99-4314-8eb1-3609f9d6bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab4ae740-9e99-4314-8eb1-3609f9d6bb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9a2a91-386d-47c2-aa3e-a63e4730ff41', 'volume_name': 'volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2d964f-a544-4b9d-802c-cd1c7462a62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2d964f-a544-4b9d-802c-cd1c7462a62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c6890a-64db-4a69-b17b-657c18afbc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Volume aa9a2a91-386d-47c2-aa3e-a63e4730ff41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41', 'volume_size': 1} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-27261243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9a2a91-386d-47c2-aa3e-a63e4730ff41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6751d8ad5b254d24a3744a48ea2464e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:35Z,use_quota=True,user_id='a32a8b837a4140319a1fa9a404d88b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a74fde8-ddff-4be2-930e-b9e63c1917f0),volume_type_id=9a74fde8-ddff-4be2-930e-b9e63c1917f0)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Creating volume aa9a2a91-386d-47c2-aa3e-a63e4730ff41 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:50:35 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:50:35 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 1073741824 Sep 15 18:50:35 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Flow 'volume_create_manager' (3295af2c-1a8e-453b-9b49-b8a05e04dd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019246f5-3eaa-4d62-898d-87e7298ebe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019246f5-3eaa-4d62-898d-87e7298ebe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-203383537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c80abc-d0d4-4e23-96e1-9153aea41329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be5f873e574c82ab44b6003c69df6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:35Z,use_quota=True,user_id='e79c27d46de347ceb6b623f155ea21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984b91d8-43bf-422d-a5cb-73c268c814be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984b91d8-43bf-422d-a5cb-73c268c814be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137de88c-a363-4cd2-8e92-81b2fde55a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137de88c-a363-4cd2-8e92-81b2fde55a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c80abc-d0d4-4e23-96e1-9153aea41329', 'volume_name': 'volume-95c80abc-d0d4-4e23-96e1-9153aea41329', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a01a41c-e97d-4f75-9201-abc21c0cd214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a01a41c-e97d-4f75-9201-abc21c0cd214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4435a1-0a05-40f2-86c4-8e3bb048dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:35 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Volume 95c80abc-d0d4-4e23-96e1-9153aea41329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c80abc-d0d4-4e23-96e1-9153aea41329', 'volume_size': 1} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:35 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc" returned: 0 in 0.729s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:35 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc Sep 15 18:50:35 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:36 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 1073741824" returned: 0 in 0.785s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:36 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8.4ba612af-d1d7-4bd6-a808-14ce4229c6fc" returned: 0 in 0.333s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:36 devstack sudo[94435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 Sep 15 18:50:36 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-quobyte-4ba612af-d1d7-4bd6-a808-14ce4229c6fc" released by "_delete_snapshot" :: held 2.704s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-quobyte-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" released by "delete_snapshot" :: held 2.749s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Created reservations ['0f854364-f795-4499-85db-ed14b4896f68', 'ae254f59-8eff-43d6-9af4-f4c238870c3d', '0e29da93-88c0-435c-a3f4-2485e991b444', '4198dada-9849-4acd-b7e0-e43be1273bca'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:36 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Delete snapshot completed successfully. Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3f1448da-bc7d-4906-8696-cd951fefa9c3 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-4ba612af-d1d7-4bd6-a808-14ce4229c6fc-delete_snapshot" released by "delete_snapshot" :: held 3.007s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:36 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41" returned: 0 in 0.402s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-203383537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c80abc-d0d4-4e23-96e1-9153aea41329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45be5f873e574c82ab44b6003c69df6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:35Z,use_quota=True,user_id='e79c27d46de347ceb6b623f155ea21a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Creating volume 95c80abc-d0d4-4e23-96e1-9153aea41329 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:50:36 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96c6890a-64db-4a69-b17b-657c18afbc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64017cb-38de-473b-9c7d-e6c1d33a4cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:36 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329 1073741824 Sep 15 18:50:36 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:36 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Volume volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 (aa9a2a91-386d-47c2-aa3e-a63e4730ff41): created successfully Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e64017cb-38de-473b-9c7d-e6c1d33a4cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Flow 'volume_create_manager' (bb00d547-0492-4c13-aca6-3475be794a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:36 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-55aa2182-f295-4e97-a470-3ab2e67a1e2c tempest-VolumeTypesAccessTest-935629130 None] Created volume successfully. Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Acquiring lock "cinder-b966fc26-63b4-4cd4-80c9-7c1730a58ba8-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-b966fc26-63b4-4cd4-80c9-7c1730a58ba8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Acquiring lock "cinder-quobyte-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Acquiring lock "cinder-aa9a2a91-386d-47c2-aa3e-a63e4730ff41-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-quobyte-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" acquired by "delete_volume" :: waited 0.088s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd78d8b-e159-4174-81c3-bde5aa59cbbc]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Lock "cinder-aa9a2a91-386d-47c2-aa3e-a63e4730ff41-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Acquiring lock "cinder-quobyte-aa9a2a91-386d-47c2-aa3e-a63e4730ff41" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Lock "cinder-quobyte-aa9a2a91-386d-47c2-aa3e-a63e4730ff41" acquired by "delete_volume" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c71067-3198-4b37-a25b-977e89b17922]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:37 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 Sep 15 18:50:37 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:37 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329 1073741824" returned: 0 in 0.883s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:37 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 Sep 15 18:50:37 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:37 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329 Sep 15 18:50:37 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:37 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" returned: 0 in 0.659s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:37 devstack sudo[94457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8 Sep 15 18:50:37 devstack sudo[94457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:37 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329" returned: 0 in 0.439s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:37 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4435a1-0a05-40f2-86c4-8e3bb048dc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c80abc-d0d4-4e23-96e1-9153aea41329', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56602ee0-40a7-4b6b-8fe5-6fa773cd94b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41" returned: 0 in 0.632s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:37 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Volume volume-95c80abc-d0d4-4e23-96e1-9153aea41329 (95c80abc-d0d4-4e23-96e1-9153aea41329): created successfully Sep 15 18:50:37 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41 Sep 15 18:50:37 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56602ee0-40a7-4b6b-8fe5-6fa773cd94b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Flow 'volume_create_manager' (3295af2c-1a8e-453b-9b49-b8a05e04dd31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d5e20c98-ea1a-4aa3-849a-49e66d6db655 tempest-VolumeQuotasAdminTestJSON-1379111022 None] Created volume successfully. Sep 15 18:50:38 devstack sudo[94457]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" returned: 0 in 0.487s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-quobyte-b966fc26-63b4-4cd4-80c9-7c1730a58ba8" released by "delete_volume" :: held 1.279s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:38 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-aa9a2a91-386d-47c2-aa3e-a63e4730ff41" returned: 0 in 0.435s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Created reservations ['4fc19b06-7b1a-4b9e-a831-f9ba48f7663d', '1ef94a2e-5a60-4bda-a9eb-135f0dcc2944', '9711a5c6-6c91-42ff-a210-219ecde2c894', '37e2a40f-472d-4a3f-a10e-ea7f9858be47'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Lock "cinder-quobyte-aa9a2a91-386d-47c2-aa3e-a63e4730ff41" released by "delete_volume" :: held 1.145s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:38 devstack cinder-volume[86137]: WARNING cinder.quota [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1617526459 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1617526459, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:50:38 devstack cinder-volume[86137]: WARNING cinder.quota [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1617526459 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1617526459, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Created reservations ['668c854a-df33-470c-952c-e01b5543efc9', '86bd3fa1-16bb-45e7-9d42-215aa13e336b', '42e141f2-d859-4fe2-ad4b-387eb5d46261', '5e0fd5f4-0c14-4acc-8c1f-c2fd911e9596'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:38 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:50:38 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:38 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:50:38 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:38 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:50:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Deleted volume successfully. Sep 15 18:50:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e49c5da6-2254-42c2-a4b8-05162103a1a1 tempest-VolumesExtendTest-1904464373 None] Lock "cinder-b966fc26-63b4-4cd4-80c9-7c1730a58ba8-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:39 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.356s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:39 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:50:39 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Deleted volume successfully. Sep 15 18:50:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f46288a-7185-41fb-bb4c-bdff419f54c3 tempest-VolumeTypesAccessTest-935629130 None] Lock "cinder-aa9a2a91-386d-47c2-aa3e-a63e4730ff41-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-49e12fee-362e-4d78-b24d-2e70df2017f4 tempest-VolumeQuotasAdminTestJSON-1178360328 None] Transfer volume completed successfully. Sep 15 18:50:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Acquiring lock "cinder-95c80abc-d0d4-4e23-96e1-9153aea41329-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Lock "cinder-95c80abc-d0d4-4e23-96e1-9153aea41329-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Acquiring lock "cinder-quobyte-95c80abc-d0d4-4e23-96e1-9153aea41329" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Lock "cinder-quobyte-95c80abc-d0d4-4e23-96e1-9153aea41329" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:41 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6dc5d3-c89c-4f81-9751-1d44452f01f8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:41 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329 Sep 15 18:50:41 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:41 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329" returned: 0 in 0.574s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:41 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329 Sep 15 18:50:41 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:41 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-95c80abc-d0d4-4e23-96e1-9153aea41329" returned: 0 in 0.327s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Lock "cinder-quobyte-95c80abc-d0d4-4e23-96e1-9153aea41329" released by "delete_volume" :: held 1.037s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Created reservations ['e456c5f0-9d74-462a-82e0-f56f38044e9d', 'bbe99d31-a436-4e33-ba2e-a75b9b9369bc', '26f2f834-a7aa-4f32-9c60-005530bcb48c', '007d1b25-35d8-4d9b-8e95-2564d949e9c1'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:42 devstack sudo[94489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:50:42 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:42 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.316s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:50:42 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Deleted volume successfully. Sep 15 18:50:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a29745a2-4c9a-409f-a245-047e87ad502a tempest-VolumeQuotasAdminTestJSON-1617623383 None] Lock "cinder-95c80abc-d0d4-4e23-96e1-9153aea41329-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:50:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:45 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:50:45 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:46 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.569s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:50:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:50:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 28 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:50:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:50:52 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=95,cinder:UPDATE=118,cinder:INSERT=36,cinder:DELETE=6 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:50:52 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=123,cinder:DELETE=10,cinder:SELECT=114,cinder:INSERT=30 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Flow 'volume_create_manager' (ac9cb20f-67bf-4ca6-a89b-915441d0950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a999ee-648d-44df-a1f2-8aaef3dc9d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a999ee-648d-44df-a1f2-8aaef3dc9d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-610444574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443183d8-35c0-45db-b8e6-ba449d8d3cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e451aaf6c464dcd8553a534bb9c2085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:55Z,use_quota=True,user_id='a1468b9d1dac4107af569f85dfb6e467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec0783a-033c-40c4-bc4e-8bf4b4e171c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec0783a-033c-40c4-bc4e-8bf4b4e171c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4e4f7c-abc8-416d-823c-dc387f651c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4e4f7c-abc8-416d-823c-dc387f651c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443183d8-35c0-45db-b8e6-ba449d8d3cbc', 'volume_name': 'volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62883459-287c-4f74-8a26-6dddcbc405be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62883459-287c-4f74-8a26-6dddcbc405be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a41cc9-b063-4a8c-acc1-9bf8b5f60767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:55 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Volume 443183d8-35c0-45db-b8e6-ba449d8d3cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc', 'volume_size': 1} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-610444574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443183d8-35c0-45db-b8e6-ba449d8d3cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e451aaf6c464dcd8553a534bb9c2085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:55Z,use_quota=True,user_id='a1468b9d1dac4107af569f85dfb6e467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Creating volume 443183d8-35c0-45db-b8e6-ba449d8d3cbc {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:50:55 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:55 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc 1073741824 Sep 15 18:50:55 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:55 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc 1073741824" returned: 0 in 0.551s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:55 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc Sep 15 18:50:55 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:56 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc" returned: 0 in 0.381s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a41cc9-b063-4a8c-acc1-9bf8b5f60767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e1879-89f4-4741-afaf-b65d339bfeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:56 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Volume volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc (443183d8-35c0-45db-b8e6-ba449d8d3cbc): created successfully Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e1879-89f4-4741-afaf-b65d339bfeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Flow 'volume_create_manager' (ac9cb20f-67bf-4ca6-a89b-915441d0950a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Flow 'volume_create_manager' (3236102f-4679-495a-998a-f288bc774c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281b0987-02e7-486c-9426-7cbdfbab7b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:56 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7dccef8a-8e29-45ea-8484-92d54fc65e0d tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Created volume successfully. Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281b0987-02e7-486c-9426-7cbdfbab7b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1855082724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328f9762-9db7-4993-8fd2-eb3566891d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63b36cdff39491587aacdcb7cd60cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:56Z,use_quota=True,user_id='c67bc808487a41938f9ff91121aedff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e8b115-d574-4f08-8100-5b0c02e2fcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e8b115-d574-4f08-8100-5b0c02e2fcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63f68d7-e42f-4abd-9747-7621af64583e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63f68d7-e42f-4abd-9747-7621af64583e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '328f9762-9db7-4993-8fd2-eb3566891d9a', 'volume_name': 'volume-328f9762-9db7-4993-8fd2-eb3566891d9a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d682507-fd79-4565-83e1-34059bf7a7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d682507-fd79-4565-83e1-34059bf7a7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13135ef6-e2c2-4fb8-8855-89752dd883d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:56 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Volume 328f9762-9db7-4993-8fd2-eb3566891d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-328f9762-9db7-4993-8fd2-eb3566891d9a', 'volume_size': 1} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1855082724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328f9762-9db7-4993-8fd2-eb3566891d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63b36cdff39491587aacdcb7cd60cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:50:56Z,use_quota=True,user_id='c67bc808487a41938f9ff91121aedff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Creating volume 328f9762-9db7-4993-8fd2-eb3566891d9a {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:50:56 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:56 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a 1073741824 Sep 15 18:50:56 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:56 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a 1073741824" returned: 0 in 0.500s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:56 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a Sep 15 18:50:56 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:57 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a" returned: 0 in 0.359s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:50:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:50:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13135ef6-e2c2-4fb8-8855-89752dd883d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328f9762-9db7-4993-8fd2-eb3566891d9a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0048f8d3-f7ce-47ba-9177-f190a97eb5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:50:57 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Volume volume-328f9762-9db7-4993-8fd2-eb3566891d9a (328f9762-9db7-4993-8fd2-eb3566891d9a): created successfully Sep 15 18:50:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0048f8d3-f7ce-47ba-9177-f190a97eb5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:50:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Flow 'volume_create_manager' (3236102f-4679-495a-998a-f288bc774c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:50:57 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-97b560e3-b337-4402-819b-37276eb1775b tempest-VolumesTransfersTest-1289690976 None] Created volume successfully. Sep 15 18:50:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Acquiring lock "cinder-443183d8-35c0-45db-b8e6-ba449d8d3cbc-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "cinder-443183d8-35c0-45db-b8e6-ba449d8d3cbc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Acquiring lock "cinder-quobyte-443183d8-35c0-45db-b8e6-ba449d8d3cbc" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:50:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "cinder-quobyte-443183d8-35c0-45db-b8e6-ba449d8d3cbc" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:50:58 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d32145f-4830-40bd-a266-99169f47607c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:50:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:58 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc Sep 15 18:50:58 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:59 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc" returned: 0 in 0.551s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:50:59 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc Sep 15 18:50:59 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:50:59 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3748facd-602e-4510-a2eb-8bf47e9afa38 tempest-VolumesTransfersTest-2108278598 None] Transfer volume completed successfully. Sep 15 18:50:59 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 15 18:50:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-443183d8-35c0-45db-b8e6-ba449d8d3cbc" returned: 0 in 0.414s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:50:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "cinder-quobyte-443183d8-35c0-45db-b8e6-ba449d8d3cbc" released by "delete_volume" :: held 1.034s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:50:59 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Created reservations ['b6588f54-b85e-4c2c-b202-7fc758d5c301', '7bb045f4-4153-4871-b803-01bcb7afb4a8', '083753d3-d298-47da-808b-91d8473ff0c3', '55ea0bf7-a7fc-40f1-946c-b53cc3c2e7b2'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:00 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:00 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Acquiring lock "cinder-328f9762-9db7-4993-8fd2-eb3566891d9a-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Lock "cinder-328f9762-9db7-4993-8fd2-eb3566891d9a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:00 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.355s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Deleted volume successfully. Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Acquiring lock "cinder-quobyte-328f9762-9db7-4993-8fd2-eb3566891d9a" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Lock "cinder-quobyte-328f9762-9db7-4993-8fd2-eb3566891d9a" acquired by "delete_volume" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d0484bfa-4df6-4d47-9b21-38fd0dff2f37 tempest-VolumeQuotasNegativeTestJSON-1314111330 None] Lock "cinder-443183d8-35c0-45db-b8e6-ba449d8d3cbc-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0a9caa-aad7-4346-b184-e3943db7be5d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:00 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a Sep 15 18:51:00 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:00 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a" returned: 0 in 0.432s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:00 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a Sep 15 18:51:00 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:01 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-328f9762-9db7-4993-8fd2-eb3566891d9a" returned: 0 in 0.386s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Lock "cinder-quobyte-328f9762-9db7-4993-8fd2-eb3566891d9a" released by "delete_volume" :: held 0.884s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:01 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Created reservations ['9a265939-c606-4566-a565-f7820e57915d', '9ac1e270-5dd5-4f15-aa14-925e792f8707', '4732a9b2-9f9a-4d4e-8cf1-31eb8411b013', '80897cb4-fd63-4310-aed7-d398042d12f1'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:01 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:01 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:02 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.455s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:02 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Deleted volume successfully. Sep 15 18:51:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3c3d7e22-fe66-4728-8901-41948c876ad5 tempest-VolumesTransfersTest-95796599 None] Lock "cinder-328f9762-9db7-4993-8fd2-eb3566891d9a-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Flow 'volume_create_manager' (9a1d9371-5c6b-4d36-90bb-f4e2bf4488dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927f4cd5-7d01-428b-aa92-fa99e00f6045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (927f4cd5-7d01-428b-aa92-fa99e00f6045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-947355121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b228c70-ef5c-458f-a13e-8faeca888d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63b36cdff39491587aacdcb7cd60cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:03Z,use_quota=True,user_id='c67bc808487a41938f9ff91121aedff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5a8a70-fbf1-4e1b-b0cc-c746791aeaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5a8a70-fbf1-4e1b-b0cc-c746791aeaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aec8c19-27e2-4814-9465-ac759837626f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aec8c19-27e2-4814-9465-ac759837626f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b228c70-ef5c-458f-a13e-8faeca888d01', 'volume_name': 'volume-5b228c70-ef5c-458f-a13e-8faeca888d01', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85247962-07b7-4691-b5af-eec19ed68166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85247962-07b7-4691-b5af-eec19ed68166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdcfbf2-97dd-45ed-84f7-deae14deb5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Volume 5b228c70-ef5c-458f-a13e-8faeca888d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b228c70-ef5c-458f-a13e-8faeca888d01', 'volume_size': 1} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-947355121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b228c70-ef5c-458f-a13e-8faeca888d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e63b36cdff39491587aacdcb7cd60cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:03Z,use_quota=True,user_id='c67bc808487a41938f9ff91121aedff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Creating volume 5b228c70-ef5c-458f-a13e-8faeca888d01 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:03 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:51:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:03 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01 1073741824 Sep 15 18:51:03 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:04 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01 1073741824" returned: 0 in 0.742s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:04 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01 Sep 15 18:51:04 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (d2cbbcac-ae45-4605-b7d7-e02f9cabaa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f810a97-5797-4c3a-9438-d17b53f7a1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f810a97-5797-4c3a-9438-d17b53f7a1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-263051357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3ceadf-803b-4c13-9ab2-011cd5c3d0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5559bd07f44cfb4ed60f40bf70f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:04Z,use_quota=True,user_id='441b0a9b12e84c1ab5036e8a1b4d5988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4477fb53-17a3-4f43-9c0e-44d0b25e8f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4477fb53-17a3-4f43-9c0e-44d0b25e8f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95efe675-4aea-4c9a-ac08-7b83b9b7388c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95efe675-4aea-4c9a-ac08-7b83b9b7388c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3ceadf-803b-4c13-9ab2-011cd5c3d0a3', 'volume_name': 'volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99fbe18-b922-49a6-820e-4cea7233cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99fbe18-b922-49a6-820e-4cea7233cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b129b2e-9603-4e7c-8e11-31352dbb6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Volume be3ceadf-803b-4c13-9ab2-011cd5c3d0a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3', 'volume_size': 1} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:04 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01" returned: 0 in 0.319s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.123s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-263051357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3ceadf-803b-4c13-9ab2-011cd5c3d0a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5559bd07f44cfb4ed60f40bf70f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:04Z,use_quota=True,user_id='441b0a9b12e84c1ab5036e8a1b4d5988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Creating volume be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:04 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdcfbf2-97dd-45ed-84f7-deae14deb5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b228c70-ef5c-458f-a13e-8faeca888d01', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29220382-5f47-46b1-b742-08991fd28746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:04 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 1073741824 Sep 15 18:51:04 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Volume volume-5b228c70-ef5c-458f-a13e-8faeca888d01 (5b228c70-ef5c-458f-a13e-8faeca888d01): created successfully Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29220382-5f47-46b1-b742-08991fd28746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Flow 'volume_create_manager' (9a1d9371-5c6b-4d36-90bb-f4e2bf4488dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ae02c626-add7-4b61-a4b3-453a17f5b274 tempest-VolumesTransfersTest-1289690976 None] Created volume successfully. Sep 15 18:51:05 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 1073741824" returned: 0 in 0.579s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:05 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 Sep 15 18:51:05 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-2f901359-f251-4f9d-a86f-8fcd7d57670e req-62934d10-a50e-469a-ab9a-11b4f4b31ce1 tempest-AttachVolumeNegativeTest-522311683 None] Terminate volume connection completed successfully. Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-2f901359-f251-4f9d-a86f-8fcd7d57670e req-62934d10-a50e-469a-ab9a-11b4f4b31ce1 tempest-AttachVolumeNegativeTest-522311683 None] Deleting attachment 849876cb-96e6-4dfb-8e6e-a02d626a7240. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:51:05 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" returned: 0 in 0.327s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b129b2e-9603-4e7c-8e11-31352dbb6f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb98ac1-1e3b-44a6-990d-748ab9a7a874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:05 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Volume volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 (be3ceadf-803b-4c13-9ab2-011cd5c3d0a3): created successfully Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb98ac1-1e3b-44a6-990d-748ab9a7a874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (d2cbbcac-ae45-4605-b7d7-e02f9cabaa13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-30a12800-9bc9-4cd2-a982-b5f947e41c52 tempest-VolumesSnapshotTestJSON-712176065 None] Created volume successfully. Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Acquiring lock "cinder-5b228c70-ef5c-458f-a13e-8faeca888d01-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Lock "cinder-5b228c70-ef5c-458f-a13e-8faeca888d01-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Acquiring lock "cinder-quobyte-5b228c70-ef5c-458f-a13e-8faeca888d01" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Lock "cinder-quobyte-5b228c70-ef5c-458f-a13e-8faeca888d01" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9599e9-6672-4c4d-a9bd-153817ca6491]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:05 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01 Sep 15 18:51:05 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:06 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01" returned: 0 in 0.512s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:06 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01 Sep 15 18:51:06 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:06 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5b228c70-ef5c-458f-a13e-8faeca888d01" returned: 0 in 0.447s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Lock "cinder-quobyte-5b228c70-ef5c-458f-a13e-8faeca888d01" released by "delete_volume" :: held 1.032s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:06 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Created reservations ['c62d26e6-05af-4034-b564-9fc26446a270', '4b63e459-b719-4e8a-9dfc-b1d27c0dc3ce', '24008132-641b-469d-b03b-12abda8adf18', 'e492ea10-3fce-4229-96af-2f02ea1cdeb7'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:07 devstack sudo[94670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:07 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Creating offline snapshot a5ec8965-bd92-4d4e-bc2f-d098b0449d1d of volume be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[38984ca2-0d26-4ed7-8c87-e16dc4d0d4f4]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:07 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 Sep 15 18:51:07 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:07 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.402s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Deleted volume successfully. Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-60e882d9-76ad-4b47-83b6-10e68ddb0d86 tempest-VolumesTransfersTest-95796599 None] Lock "cinder-5b228c70-ef5c-458f-a13e-8faeca888d01-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:07 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" returned: 0 in 0.474s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:07 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d 1G Sep 15 18:51:07 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:08 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d 1G" returned: 0 in 0.630s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:08 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d Sep 15 18:51:08 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:08 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d" returned: 0 in 0.409s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:08 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d is being set with open permissions: ugo+rw Sep 15 18:51:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:08 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d Sep 15 18:51:08 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:09 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d" returned: 0 in 0.354s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:09 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.info Sep 15 18:51:09 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:09 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.info" returned: 0 in 0.321s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:09 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.info is being set with open permissions: ugo+rw Sep 15 18:51:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:09 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.info Sep 15 18:51:09 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:09 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.info" returned: 0 in 0.259s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.679s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:09 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4291dab4-3ff5-47da-ae16-b16fc2b8f798 tempest-VolumesSnapshotTestJSON-712176065 None] Create snapshot completed successfully Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Flow 'volume_create_manager' (ff132c9d-9cc4-4ee6-828b-c4fccea8aed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd22832f-47dd-4c2f-9b87-ee568c91b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd22832f-47dd-4c2f-9b87-ee568c91b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2133125283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6569cdb2-2ead-480c-bc12-6016efe14ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d184fbff86548869f7f12307a555494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:10Z,use_quota=True,user_id='1997743e51954f8f8d530058dff43a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42036626-873d-4d39-90ef-3c0eae8fad4a),volume_type_id=42036626-873d-4d39-90ef-3c0eae8fad4a)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc92a830-7ad3-4544-8b01-f3da69502d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc92a830-7ad3-4544-8b01-f3da69502d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7869ae-4931-4e5f-9e76-572264fb219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7869ae-4931-4e5f-9e76-572264fb219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6569cdb2-2ead-480c-bc12-6016efe14ca5', 'volume_name': 'volume-6569cdb2-2ead-480c-bc12-6016efe14ca5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be78565-1a1e-4ee5-9ae1-163277996d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be78565-1a1e-4ee5-9ae1-163277996d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d64ba13-71f5-4c92-b325-db554b95c6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:10 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Volume 6569cdb2-2ead-480c-bc12-6016efe14ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6569cdb2-2ead-480c-bc12-6016efe14ca5', 'volume_size': 1} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2133125283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6569cdb2-2ead-480c-bc12-6016efe14ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d184fbff86548869f7f12307a555494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:10Z,use_quota=True,user_id='1997743e51954f8f8d530058dff43a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42036626-873d-4d39-90ef-3c0eae8fad4a),volume_type_id=42036626-873d-4d39-90ef-3c0eae8fad4a)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Creating volume 6569cdb2-2ead-480c-bc12-6016efe14ca5 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:10 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:10 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 1073741824 Sep 15 18:51:10 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-a5ec8965-bd92-4d4e-bc2f-d098b0449d1d-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-a5ec8965-bd92-4d4e-bc2f-d098b0449d1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-a5ec8965-bd92-4d4e-bc2f-d098b0449d1d" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-a5ec8965-bd92-4d4e-bc2f-d098b0449d1d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Deleting offline snapshot a5ec8965-bd92-4d4e-bc2f-d098b0449d1d of volume be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] snapshot_file for this snap is: volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12f22a7-3abb-410b-9448-f51dc6893e99]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:10 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d Sep 15 18:51:10 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:11 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 1073741824" returned: 0 in 0.673s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:11 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 Sep 15 18:51:11 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:11 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d" returned: 0 in 0.544s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9789f2ec-c11d-4894-a88d-3dd8d231ad83]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:11 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5" returned: 0 in 0.344s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d64ba13-71f5-4c92-b325-db554b95c6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6569cdb2-2ead-480c-bc12-6016efe14ca5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b792b806-2d58-4bb9-bcc4-57dd4ea61516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:11 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Volume volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 (6569cdb2-2ead-480c-bc12-6016efe14ca5): created successfully Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b792b806-2d58-4bb9-bcc4-57dd4ea61516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Flow 'volume_create_manager' (ff132c9d-9cc4-4ee6-828b-c4fccea8aed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3288c846-e6c8-4f56-afca-bbfc7fe0e6cf tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Created volume successfully. Sep 15 18:51:11 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 Sep 15 18:51:11 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:11 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" returned: 0 in 0.510s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:11 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d Sep 15 18:51:11 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:12 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d" returned: 0 in 0.428s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:12 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d Sep 15 18:51:12 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:12 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3.a5ec8965-bd92-4d4e-bc2f-d098b0449d1d" returned: 0 in 0.333s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-a5ec8965-bd92-4d4e-bc2f-d098b0449d1d" released by "_delete_snapshot" :: held 2.047s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" released by "delete_snapshot" :: held 2.101s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Created reservations ['e701cd28-2eef-477e-aa59-b94f04ea659c', 'b46a1ac4-ccae-4f66-a4a1-b66fae641362', 'fec9f99d-6010-4f88-83e1-d7ff2796c355', '8c0b51ce-1ab8-454b-a22d-49712152af24'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:12 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Delete snapshot completed successfully. Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5819d947-e554-4637-ad9c-58c1cd02abf4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-a5ec8965-bd92-4d4e-bc2f-d098b0449d1d-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3dbdbffe-aa11-4bae-9372-933fa3cf77b1 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3dbdbffe-aa11-4bae-9372-933fa3cf77b1 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdbffe-aa11-4bae-9372-933fa3cf77b1 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3dbdbffe-aa11-4bae-9372-933fa3cf77b1 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3dbdbffe-aa11-4bae-9372-933fa3cf77b1 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3dbdbffe-aa11-4bae-9372-933fa3cf77b1 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:13 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:13 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:13 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3dbdbffe-aa11-4bae-9372-933fa3cf77b1 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.302s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:13 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-3dbdbffe-aa11-4bae-9372-933fa3cf77b1 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:13 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3dbdbffe-aa11-4bae-9372-933fa3cf77b1 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Retype volume completed successfully. Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Acquiring lock "cinder-6569cdb2-2ead-480c-bc12-6016efe14ca5-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "cinder-6569cdb2-2ead-480c-bc12-6016efe14ca5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Acquiring lock "cinder-quobyte-6569cdb2-2ead-480c-bc12-6016efe14ca5" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "cinder-quobyte-6569cdb2-2ead-480c-bc12-6016efe14ca5" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1c5cf5-6d8b-4373-9b31-c3fb037222f2]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:14 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 Sep 15 18:51:14 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (e8febc80-d707-4df0-a3ca-b6afe9899971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1860a3-2216-4ca7-ba65-10c8ae73d619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1860a3-2216-4ca7-ba65-10c8ae73d619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-233605826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2a4840-5749-4a72-a0a6-be15e321836f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5559bd07f44cfb4ed60f40bf70f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:15Z,use_quota=True,user_id='441b0a9b12e84c1ab5036e8a1b4d5988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39a9fc5-376b-448d-a036-c1a4d9f894d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39a9fc5-376b-448d-a036-c1a4d9f894d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f4d662-1307-4345-9921-1d51f4101ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f4d662-1307-4345-9921-1d51f4101ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2a4840-5749-4a72-a0a6-be15e321836f', 'volume_name': 'volume-ae2a4840-5749-4a72-a0a6-be15e321836f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5271928a-6354-4614-85e5-46f8ce18ff3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5271928a-6354-4614-85e5-46f8ce18ff3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6749ff-7b81-4efa-be20-748a1e362eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:14 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Volume ae2a4840-5749-4a72-a0a6-be15e321836f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2a4840-5749-4a72-a0a6-be15e321836f', 'volume_size': 1} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-233605826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2a4840-5749-4a72-a0a6-be15e321836f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5559bd07f44cfb4ed60f40bf70f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:15Z,use_quota=True,user_id='441b0a9b12e84c1ab5036e8a1b4d5988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Creating volume ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:14 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:14 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f 1073741824 Sep 15 18:51:14 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:14 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5" returned: 0 in 0.456s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:14 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5 Sep 15 18:51:14 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:15 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6569cdb2-2ead-480c-bc12-6016efe14ca5" returned: 0 in 0.371s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "cinder-quobyte-6569cdb2-2ead-480c-bc12-6016efe14ca5" released by "delete_volume" :: held 0.914s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:15 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f 1073741824" returned: 0 in 0.577s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:15 devstack cinder-volume[86137]: WARNING cinder.quota [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:51:15 devstack cinder-volume[86137]: WARNING cinder.quota [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Created reservations ['d47e6634-8f7e-4f55-8a6f-cb5164b9d154', '53a8e435-42fd-437e-9829-18cca35da458', '1492e094-422c-48eb-86bb-a0b00d4ba833', '3834e13e-3d79-4863-80d2-228f726adf8d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:15 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f Sep 15 18:51:15 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:15 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:15 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:15 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f" returned: 0 in 0.302s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6749ff-7b81-4efa-be20-748a1e362eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2a4840-5749-4a72-a0a6-be15e321836f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f90df21-a9fb-4b23-9cd4-de9bd929f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:15 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Volume volume-ae2a4840-5749-4a72-a0a6-be15e321836f (ae2a4840-5749-4a72-a0a6-be15e321836f): created successfully Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f90df21-a9fb-4b23-9cd4-de9bd929f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (e8febc80-d707-4df0-a3ca-b6afe9899971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-30d9b14e-88a2-4fa8-80f9-c01b7a21ae6a tempest-VolumesSnapshotTestJSON-712176065 None] Created volume successfully. Sep 15 18:51:15 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.304s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Deleted volume successfully. Sep 15 18:51:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c4c01cc0-8eb5-4702-9942-d7bdb0c9c045 tempest-VolumeRetypeWithoutMigrationTest-1867640808 None] Lock "cinder-6569cdb2-2ead-480c-bc12-6016efe14ca5-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Creating offline snapshot 692146f1-5edb-4a61-a02e-0090af214933 of volume ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:51:17 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daeca35-b219-4190-a169-576c69492e70]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:17 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f Sep 15 18:51:17 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:17 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f" returned: 0 in 0.780s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:17 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 1G Sep 15 18:51:17 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:18 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 1G" returned: 0 in 0.861s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2a4840-5749-4a72-a0a6-be15e321836f -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:18 devstack sudo[94788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2a4840-5749-4a72-a0a6-be15e321836f -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 Sep 15 18:51:18 devstack sudo[94788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Flow 'volume_create_manager' (0eb2a331-9cb4-4259-92d2-0cccc9aa9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03166560-8827-46c1-8345-986681b82a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03166560-8827-46c1-8345-986681b82a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-367530014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4eb96dba15b44a381a9a708997906a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:19Z,use_quota=True,user_id='cc1772ea28ee4d438dffb1ac6de01382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7bcc11-c943-442b-aee4-a6010c3c0da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a7bcc11-c943-442b-aee4-a6010c3c0da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd0db78-dead-4501-8f4b-5298704cb1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd0db78-dead-4501-8f4b-5298704cb1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f', 'volume_name': 'volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad47da0-ae8b-424c-9249-df922b541a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad47da0-ae8b-424c-9249-df922b541a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410a1ac7-73ad-4047-9acf-fc2ffbc2d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:18 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Volume 605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f', 'volume_size': 1} Sep 15 18:51:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:19 devstack sudo[94788]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae2a4840-5749-4a72-a0a6-be15e321836f -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933" returned: 0 in 0.364s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:19 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 is being set with open permissions: ugo+rw Sep 15 18:51:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:19 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 Sep 15 18:51:19 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:19 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933" returned: 0 in 0.314s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:19 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.info Sep 15 18:51:19 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:19 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.info" returned: 0 in 0.307s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:19 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.info is being set with open permissions: ugo+rw Sep 15 18:51:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:19 devstack sudo[94800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.info Sep 15 18:51:19 devstack sudo[94800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:19 devstack sudo[94800]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.info" returned: 0 in 0.280s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.045s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.226s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-367530014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4eb96dba15b44a381a9a708997906a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:19Z,use_quota=True,user_id='cc1772ea28ee4d438dffb1ac6de01382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Creating volume 605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:20 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:20 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f 1073741824 Sep 15 18:51:20 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:20 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0cd1f606-9520-4a7c-bb86-8e6f104c9e94 tempest-VolumesSnapshotTestJSON-712176065 None] Create snapshot completed successfully Sep 15 18:51:20 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f 1073741824" returned: 0 in 0.684s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:20 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f Sep 15 18:51:20 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:21 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f" returned: 0 in 0.363s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410a1ac7-73ad-4047-9acf-fc2ffbc2d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c263897-59f4-487f-aeee-660c4721f844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (2e0cf4cd-ab7c-4ed3-b8ae-cd3aeef23d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a87ca5-7520-4f71-85aa-7603536b6a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a87ca5-7520-4f71-85aa-7603536b6a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-333610784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cc0db66-888f-4bdd-9e86-3bdfe1775e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5559bd07f44cfb4ed60f40bf70f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=692146f1-5edb-4a61-a02e-0090af214933,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:21Z,use_quota=True,user_id='441b0a9b12e84c1ab5036e8a1b4d5988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce9dc57-569e-4fb6-a34b-5bb84e28de30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce9dc57-569e-4fb6-a34b-5bb84e28de30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26301fe1-0918-427a-a2d7-ddc9530e3f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26301fe1-0918-427a-a2d7-ddc9530e3f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6cc0db66-888f-4bdd-9e86-3bdfe1775e14', 'volume_name': 'volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14', 'volume_size': 2, 'snapshot_id': '692146f1-5edb-4a61-a02e-0090af214933'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85dc883-5c75-4157-bd59-b8a178dd2c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85dc883-5c75-4157-bd59-b8a178dd2c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d4fef4-66e4-44e5-84e7-4878491c905e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:21 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Volume 6cc0db66-888f-4bdd-9e86-3bdfe1775e14: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14', 'volume_size': 2, 'snapshot_id': '692146f1-5edb-4a61-a02e-0090af214933'} Sep 15 18:51:21 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Volume volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f (605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f): created successfully Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c263897-59f4-487f-aeee-660c4721f844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Flow 'volume_create_manager' (0eb2a331-9cb4-4259-92d2-0cccc9aa9107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-692146f1-5edb-4a61-a02e-0090af214933-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" by "_create_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:21 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b1636122-777b-4c66-ad2a-b5dc5cd938ff tempest-VolumesTransfersV357Test-33162030 None] Created volume successfully. Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-692146f1-5edb-4a61-a02e-0090af214933-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" acquired by "_create_volume_from_snapshot" :: waited 0.091s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Creating volume 6cc0db66-888f-4bdd-9e86-3bdfe1775e14 from snapshot 692146f1-5edb-4a61-a02e-0090af214933 {{(pid=86137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] snapshot: 692146f1-5edb-4a61-a02e-0090af214933, volume: 6cc0db66-888f-4bdd-9e86-3bdfe1775e14, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded9ca14-79bb-4a8a-9d63-cef2e8601642]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:21 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 Sep 15 18:51:21 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:22 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933" returned: 0 in 0.881s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae2a4840-5749-4a72-a0a6-be15e321836f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:51:22 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e345ef2f-dbdb-450f-af92-51c98057485c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:22 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f Sep 15 18:51:22 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:23 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f" returned: 0 in 0.508s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 18:51:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 18:51:23 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 18:51:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:23 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 Sep 15 18:51:23 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:23 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6b56242a-12c5-41eb-8c94-964e9d7eb1d3 tempest-VolumesTransfersV357Test-191083714 None] Transfer volume completed successfully. Sep 15 18:51:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Acquiring lock "cinder-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Lock "cinder-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Acquiring lock "cinder-quobyte-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Lock "cinder-quobyte-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f" acquired by "delete_volume" :: waited 0.043s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:25 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3715b1ae-c897-49ce-9bb8-d6afec3a833e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:26 devstack sudo[94906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f Sep 15 18:51:26 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:26 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f" returned: 0 in 1.057s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:27 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f Sep 15 18:51:27 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:28 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f" returned: 0 in 1.109s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Lock "cinder-quobyte-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f" released by "delete_volume" :: held 2.330s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:28 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Created reservations ['4e791350-0503-4f9f-9a16-850afaf75282', '2dc24c97-a4c7-4c26-bff7-d693f7e11005', '95c45d95-a130-4156-9656-5b387bafbd4d', '896eda01-3a15-43dd-b10c-78266022b572'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:28 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:28 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:29 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 1.091s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:29 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Deleted volume successfully. Sep 15 18:51:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f26edc11-f2d9-472b-8c0a-35ee1ab1ae96 tempest-VolumesTransfersV357Test-474921067 None] Lock "cinder-605a32ea-bdbd-4c15-9e3b-5ddfc3e5ff6f-delete_volume" released by "delete_volume" :: held 4.224s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Flow 'volume_create_manager' (dc8afc59-165d-4585-a992-3bd3961b932d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3b117e-5333-4aaa-8ceb-4a43f376efa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3b117e-5333-4aaa-8ceb-4a43f376efa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1883224022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4eb96dba15b44a381a9a708997906a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:31Z,use_quota=True,user_id='cc1772ea28ee4d438dffb1ac6de01382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e576f19b-f975-4644-b307-927c1a7a3fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e576f19b-f975-4644-b307-927c1a7a3fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b248a7b2-c3bd-4fdf-a0cc-4f355d50ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b248a7b2-c3bd-4fdf-a0cc-4f355d50ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4', 'volume_name': 'volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34dea14-89a7-459b-b751-8ac69df3be2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34dea14-89a7-459b-b751-8ac69df3be2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc694a62-2929-4e62-8631-d2251b5189aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:31 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Volume 21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4', 'volume_size': 1} Sep 15 18:51:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" returned: 0 in 11.623s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:34 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f, size 1024.00 MB, duration 11.62 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:51:34 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Converted 1024.00 MB image at 88.09 MB/s Sep 15 18:51:34 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 is being set with open permissions: ugo+rw Sep 15 18:51:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:34 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 Sep 15 18:51:34 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:35 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" returned: 0 in 0.305s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" released by "_copy_volume_from_snapshot" :: held 13.520s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-692146f1-5edb-4a61-a02e-0090af214933-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" released by "_create_volume_from_snapshot" :: held 13.670s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.763s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.332s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1883224022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4eb96dba15b44a381a9a708997906a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:31Z,use_quota=True,user_id='cc1772ea28ee4d438dffb1ac6de01382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Creating volume 21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:35 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:35 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 1073741824 Sep 15 18:51:35 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28d4fef4-66e4-44e5-84e7-4878491c905e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14', 'volume_size': 2, 'snapshot_id': '692146f1-5edb-4a61-a02e-0090af214933'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a506f6-cf10-4a7c-8410-da8d62740951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:35 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Volume volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 (6cc0db66-888f-4bdd-9e86-3bdfe1775e14): created successfully Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a506f6-cf10-4a7c-8410-da8d62740951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (2e0cf4cd-ab7c-4ed3-b8ae-cd3aeef23d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:35 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ca0f85f3-153a-4a9c-9bee-4ff2f41cef53 tempest-VolumesSnapshotTestJSON-712176065 None] Created volume successfully. Sep 15 18:51:35 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 1073741824" returned: 0 in 0.548s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:35 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 Sep 15 18:51:35 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:35 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4" returned: 0 in 0.288s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:51:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc694a62-2929-4e62-8631-d2251b5189aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ad9274-e1ec-4bd6-8b70-9aaacd321377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:36 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Volume volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 (21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4): created successfully Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ad9274-e1ec-4bd6-8b70-9aaacd321377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Flow 'volume_create_manager' (dc8afc59-165d-4585-a992-3bd3961b932d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:36 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-cbc705a6-87c8-41ab-9b8f-4224d88ca6a2 tempest-VolumesTransfersV357Test-33162030 None] Created volume successfully. Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-6cc0db66-888f-4bdd-9e86-3bdfe1775e14-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-6cc0db66-888f-4bdd-9e86-3bdfe1775e14-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad905166-02aa-4647-b253-7564f810081d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:36 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 Sep 15 18:51:36 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:36 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" returned: 0 in 0.398s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:36 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14 Sep 15 18:51:36 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:37 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" returned: 0 in 0.277s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-6cc0db66-888f-4bdd-9e86-3bdfe1775e14" released by "delete_volume" :: held 0.727s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Created reservations ['dd81ee0e-0725-4d05-9c00-d2deea91bc36', '034ddd99-b69d-4a64-a16d-78ddfc582e42', '90fda0d0-fef6-461c-97aa-0d52db2cdb02', '4d4def7e-414c-47c8-8ea0-610600c735aa'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Acquiring lock "cinder-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Lock "cinder-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Acquiring lock "cinder-quobyte-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:37 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:37 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Lock "cinder-quobyte-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2767d2c9-65b8-4373-b501-06b678e2e6c0]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-692146f1-5edb-4a61-a02e-0090af214933-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-692146f1-5edb-4a61-a02e-0090af214933-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-ae2a4840-5749-4a72-a0a6-be15e321836f" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-ae2a4840-5749-4a72-a0a6-be15e321836f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-692146f1-5edb-4a61-a02e-0090af214933" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:37 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 Sep 15 18:51:37 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-692146f1-5edb-4a61-a02e-0090af214933" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Deleting offline snapshot 692146f1-5edb-4a61-a02e-0090af214933 of volume ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] snapshot_file for this snap is: volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[430541fe-fb89-443e-851c-f66683f29cac]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:37 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.342s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Deleted volume successfully. Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-144bd464-c34a-4466-adb9-40344f378868 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-6cc0db66-888f-4bdd-9e86-3bdfe1775e14-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:37 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 Sep 15 18:51:37 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:37 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4" returned: 0 in 0.464s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:37 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4 Sep 15 18:51:37 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:38 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933" returned: 0 in 0.444s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae2a4840-5749-4a72-a0a6-be15e321836f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[81012e34-5eea-4141-8795-e7a8530e9b30]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:38 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4" returned: 0 in 0.299s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Lock "cinder-quobyte-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4" released by "delete_volume" :: held 0.838s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:38 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f Sep 15 18:51:38 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Created reservations ['b174b6f5-241c-49aa-af11-f5ea26c3008c', 'e20cc9a4-9e6e-4b69-9bc6-ac39613fac6f', '59488eb3-a983-42e1-bac5-32f8f0a7c216', '6ac603b9-ccd5-45df-90a6-d73d506688e9'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:38 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:38 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:38 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.304s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Deleted volume successfully. Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f82b61d-8beb-4299-9caa-e74100dfa7ec tempest-VolumesTransfersV357Test-474921067 None] Lock "cinder-21c1d17e-fff2-4321-9ee2-6c0fa4a7f7c4-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:38 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f" returned: 0 in 0.659s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:38 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 Sep 15 18:51:38 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:39 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933" returned: 0 in 0.395s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:39 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933 Sep 15 18:51:39 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:39 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f.692146f1-5edb-4a61-a02e-0090af214933" returned: 0 in 0.279s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-692146f1-5edb-4a61-a02e-0090af214933" released by "_delete_snapshot" :: held 1.964s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-ae2a4840-5749-4a72-a0a6-be15e321836f" released by "delete_snapshot" :: held 2.011s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Created reservations ['3b0084ca-996a-4f2c-a588-532606610d30', '64c7f2e8-888a-4e8a-9be0-b6b66d670d5c', 'ce129fba-7cb2-4741-ad84-51023018fde7', 'fad3073b-09d1-4170-8604-64aeb15eb30c'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:39 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Delete snapshot completed successfully. Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3555cbc-1108-43ce-bb18-fbb900d01750 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-692146f1-5edb-4a61-a02e-0090af214933-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Flow 'volume_create_manager' (652424b7-5540-4271-af83-7283a3c9648c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8775596d-b2c4-42c1-9389-b104f03a3b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8775596d-b2c4-42c1-9389-b104f03a3b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-85568718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88b921d-9ea9-4cb1-a118-4a302c91e5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122bfebb86694961a15127c238f03dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:40Z,use_quota=True,user_id='7671b82e468043e69b8285cd5dedf438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ef445e-2484-4ad1-a3b9-3f66d4512d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5ef445e-2484-4ad1-a3b9-3f66d4512d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abc7c0c-c856-455d-8a62-1bd81c4db43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abc7c0c-c856-455d-8a62-1bd81c4db43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88b921d-9ea9-4cb1-a118-4a302c91e5ca', 'volume_name': 'volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04375cee-0ba5-4d1e-8cc6-d76f3fa00eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04375cee-0ba5-4d1e-8cc6-d76f3fa00eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a4b51e-ac55-47f2-9b63-e9adc11ce5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:39 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Volume e88b921d-9ea9-4cb1-a118-4a302c91e5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca', 'volume_size': 1} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-85568718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88b921d-9ea9-4cb1-a118-4a302c91e5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122bfebb86694961a15127c238f03dfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:40Z,use_quota=True,user_id='7671b82e468043e69b8285cd5dedf438',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Creating volume e88b921d-9ea9-4cb1-a118-4a302c91e5ca {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:39 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:51:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:39 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca 1073741824 Sep 15 18:51:39 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:40 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca 1073741824" returned: 0 in 0.500s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:40 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca Sep 15 18:51:40 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:40 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" returned: 0 in 0.250s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a4b51e-ac55-47f2-9b63-e9adc11ce5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dca5d8-3038-4e3f-a78f-f6f2f276a829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:40 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Volume volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca (e88b921d-9ea9-4cb1-a118-4a302c91e5ca): created successfully Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56dca5d8-3038-4e3f-a78f-f6f2f276a829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Flow 'volume_create_manager' (652424b7-5540-4271-af83-7283a3c9648c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-543d6df6-6d11-4e8f-bf10-b02e48ee9344 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Created volume successfully. Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-ae2a4840-5749-4a72-a0a6-be15e321836f-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-ae2a4840-5749-4a72-a0a6-be15e321836f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-ae2a4840-5749-4a72-a0a6-be15e321836f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-ae2a4840-5749-4a72-a0a6-be15e321836f" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c3a725-9bc6-4af8-bfda-c954e552442f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:41 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f Sep 15 18:51:41 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:41 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f" returned: 0 in 0.379s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:41 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f Sep 15 18:51:41 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:41 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ae2a4840-5749-4a72-a0a6-be15e321836f" returned: 0 in 0.262s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-ae2a4840-5749-4a72-a0a6-be15e321836f" released by "delete_volume" :: held 0.717s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Created reservations ['3e2e93a0-75e2-4eee-8c57-dd6153b8e152', '00adb173-154a-446f-a721-03634dba481f', 'f9e2050f-8ede-4dc6-b5d6-4ace2adbd467', '6b1777ba-3948-4db1-9696-f74f7cbdb09b'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:41 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:41 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:42 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.402s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:42 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Deleted volume successfully. Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ba39e10f-1664-411b-9bd0-e6851af9ed41 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-ae2a4840-5749-4a72-a0a6-be15e321836f-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Creating offline snapshot 16aa19e1-8216-402b-af8e-6f393ac85f1c of volume e88b921d-9ea9-4cb1-a118-4a302c91e5ca {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd35ac5-24c2-466f-b806-c8060a072e60]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:42 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca Sep 15 18:51:42 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (e804a24a-4401-4f2c-bf86-f9ed20ad3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2180c44-1bb1-41c0-8b38-bd81757121f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:42 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" returned: 0 in 0.454s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2180c44-1bb1-41c0-8b38-bd81757121f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-228736547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be07d179-7815-4474-bce0-5bf402d164f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5559bd07f44cfb4ed60f40bf70f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:43Z,use_quota=True,user_id='441b0a9b12e84c1ab5036e8a1b4d5988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7146fddd-1ff0-48e0-bd5c-1eb0d3dd648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7146fddd-1ff0-48e0-bd5c-1eb0d3dd648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332af2be-2a8f-4765-bfa3-c214661cd727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:42 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c 1G Sep 15 18:51:42 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332af2be-2a8f-4765-bfa3-c214661cd727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be07d179-7815-4474-bce0-5bf402d164f9', 'volume_name': 'volume-be07d179-7815-4474-bce0-5bf402d164f9', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee0b60e-c10b-4b7e-9688-ece1f5a04e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee0b60e-c10b-4b7e-9688-ece1f5a04e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7dbd2a-b9e9-462c-8718-7da5f29c4adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:42 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Volume be07d179-7815-4474-bce0-5bf402d164f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be07d179-7815-4474-bce0-5bf402d164f9', 'volume_size': 1} Sep 15 18:51:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:43 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c 1G" returned: 0 in 0.477s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:43 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c Sep 15 18:51:43 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:43 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c" returned: 0 in 0.344s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:43 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c is being set with open permissions: ugo+rw Sep 15 18:51:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:43 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c Sep 15 18:51:43 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:43 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c" returned: 0 in 0.315s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:44 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.info Sep 15 18:51:44 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:44 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.info" returned: 0 in 0.335s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:44 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.info is being set with open permissions: ugo+rw Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:44 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.info Sep 15 18:51:44 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:44 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.info" returned: 0 in 0.292s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.366s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-228736547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be07d179-7815-4474-bce0-5bf402d164f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5559bd07f44cfb4ed60f40bf70f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:43Z,use_quota=True,user_id='441b0a9b12e84c1ab5036e8a1b4d5988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Creating volume be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:44 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:51:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:44 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 1073741824 Sep 15 18:51:44 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:44 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f7dbd0dd-79c1-4cc8-b1f4-3aaf645bbe07 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Create snapshot completed successfully Sep 15 18:51:45 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 1073741824" returned: 0 in 0.559s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:45 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 Sep 15 18:51:45 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Flow 'volume_create_manager' (0b72d184-58c1-438d-baba-b07abd3c6b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:45 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945ea4bf-a670-4f0f-9266-2263636a9ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9" returned: 0 in 0.458s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:45 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945ea4bf-a670-4f0f-9266-2263636a9ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1955467741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21812cd1-c9d3-444b-92fd-a33bc8fd787a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8215b2a20026414685f31dec59452f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:46Z,use_quota=True,user_id='0914da0966ef4780a18a62ba87164496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:45 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc18629-6dc5-4b7e-9ed9-ea996234b7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cc18629-6dc5-4b7e-9ed9-ea996234b7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc8aa15-47d4-4ef9-a270-076f7a701e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc8aa15-47d4-4ef9-a270-076f7a701e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21812cd1-c9d3-444b-92fd-a33bc8fd787a', 'volume_name': 'volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9c01b7-63a6-41ec-a653-6b507f54bc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9c01b7-63a6-41ec-a653-6b507f54bc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71a6e68-2833-4ee3-8135-1b02d6d5e147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:45 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Volume 21812cd1-c9d3-444b-92fd-a33bc8fd787a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a', 'volume_size': 1} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1955467741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21812cd1-c9d3-444b-92fd-a33bc8fd787a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8215b2a20026414685f31dec59452f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:46Z,use_quota=True,user_id='0914da0966ef4780a18a62ba87164496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Creating volume 21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:51:45 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7dbd2a-b9e9-462c-8718-7da5f29c4adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be07d179-7815-4474-bce0-5bf402d164f9', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac91a1ff-b7d1-4c51-80f4-c67e80badece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:45 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a 1073741824 Sep 15 18:51:45 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Volume volume-be07d179-7815-4474-bce0-5bf402d164f9 (be07d179-7815-4474-bce0-5bf402d164f9): created successfully Sep 15 18:51:45 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac91a1ff-b7d1-4c51-80f4-c67e80badece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (e804a24a-4401-4f2c-bf86-f9ed20ad3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Acquiring lock "cinder-16aa19e1-8216-402b-af8e-6f393ac85f1c-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:45 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d877399a-3ae6-4e8a-ba7d-d1011e48a9dc tempest-VolumesSnapshotTestJSON-712176065 None] Created volume successfully. Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-16aa19e1-8216-402b-af8e-6f393ac85f1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Acquiring lock "cinder-quobyte-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-quobyte-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Acquiring lock "cinder-quobyte-16aa19e1-8216-402b-af8e-6f393ac85f1c" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-quobyte-16aa19e1-8216-402b-af8e-6f393ac85f1c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Deleting offline snapshot 16aa19e1-8216-402b-af8e-6f393ac85f1c of volume e88b921d-9ea9-4cb1-a118-4a302c91e5ca {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:51:46 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] snapshot_file for this snap is: volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.287s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 28 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[db460925-333e-4aad-8f88-ec10fe172a97]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:46 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c Sep 15 18:51:46 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:46 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a 1073741824" returned: 0 in 0.524s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:46 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a Sep 15 18:51:46 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:46 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c" returned: 0 in 0.415s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[78297fb5-d6c3-448c-97e1-3220cc95b668]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:46 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca Sep 15 18:51:46 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:46 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a" returned: 0 in 0.293s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71a6e68-2833-4ee3-8135-1b02d6d5e147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f605bd06-26d3-42c1-9f56-169dc73ab2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:46 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Volume volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a (21812cd1-c9d3-444b-92fd-a33bc8fd787a): created successfully Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f605bd06-26d3-42c1-9f56-169dc73ab2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Flow 'volume_create_manager' (0b72d184-58c1-438d-baba-b07abd3c6b51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-fe5c5bf1-7016-4068-ac3a-3881a699a78a tempest-VolumesCloneTest-744894190 None] Created volume successfully. Sep 15 18:51:46 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" returned: 0 in 0.359s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:46 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c Sep 15 18:51:46 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Creating offline snapshot 282af960-dc3e-48ac-bb2a-129c37c9b9a5 of volume be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95e2fcb-0ef2-477b-90dc-092255f046cf]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:47 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c" returned: 0 in 0.409s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:47 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c Sep 15 18:51:47 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:47 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 Sep 15 18:51:47 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:47 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca.16aa19e1-8216-402b-af8e-6f393ac85f1c" returned: 0 in 0.260s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-quobyte-16aa19e1-8216-402b-af8e-6f393ac85f1c" released by "_delete_snapshot" :: held 1.571s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-quobyte-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" released by "delete_snapshot" :: held 1.598s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:47 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9" returned: 0 in 0.365s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:47 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 1G Sep 15 18:51:47 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Created reservations ['c4adc55e-9967-4675-b468-ba1533feb32c', '66d0a139-89e2-449e-bf49-996adab6011a', '3db6121f-7733-4668-8239-075583992707', 'e65def5c-361a-4fc0-840c-87b06207df78'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Delete snapshot completed successfully. Sep 15 18:51:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0d3d058-cc24-4b22-bdaa-93765b59eafc tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-16aa19e1-8216-402b-af8e-6f393ac85f1c-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:48 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 1G" returned: 0 in 0.440s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be07d179-7815-4474-bce0-5bf402d164f9 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:48 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be07d179-7815-4474-bce0-5bf402d164f9 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 Sep 15 18:51:48 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Acquiring lock "cinder-e88b921d-9ea9-4cb1-a118-4a302c91e5ca-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-e88b921d-9ea9-4cb1-a118-4a302c91e5ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Acquiring lock "cinder-quobyte-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-quobyte-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba21284-409a-49e4-9b3d-5e494cd00f00]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Flow 'volume_create_manager' (1e07a945-8789-4d56-bde9-3ac135068a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375bbcdb-2728-4721-8cd3-dda21d7959b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375bbcdb-2728-4721-8cd3-dda21d7959b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-842080854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=127f3db6-7e9e-4ef3-9e33-948a57f28db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8215b2a20026414685f31dec59452f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=21812cd1-c9d3-444b-92fd-a33bc8fd787a,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:48Z,use_quota=True,user_id='0914da0966ef4780a18a62ba87164496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c795d80-43bd-41cf-bbea-47228b6f4de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c795d80-43bd-41cf-bbea-47228b6f4de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032a8631-132e-4d9c-95d5-a93a8cd822ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:48 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032a8631-132e-4d9c-95d5-a93a8cd822ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '127f3db6-7e9e-4ef3-9e33-948a57f28db0', 'volume_name': 'volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0', 'volume_size': 2, 'source_volid': '21812cd1-c9d3-444b-92fd-a33bc8fd787a', 'source_volstatus': 'available'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fe2d98-850e-433e-8a57-231c183c93e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9fe2d98-850e-433e-8a57-231c183c93e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:48 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387dbb06-e701-45b2-a07d-3bbcac46781c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:48 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:48 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Volume 127f3db6-7e9e-4ef3-9e33-948a57f28db0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0', 'volume_size': 2, 'source_volid': '21812cd1-c9d3-444b-92fd-a33bc8fd787a', 'source_volstatus': 'available'} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be07d179-7815-4474-bce0-5bf402d164f9 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5" returned: 0 in 0.448s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:48 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 is being set with open permissions: ugo+rw Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:48 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 Sep 15 18:51:48 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:48 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5" returned: 0 in 0.242s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:48 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" returned: 0 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:48 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca Sep 15 18:51:48 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:48 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.info Sep 15 18:51:48 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:49 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" returned: 0 in 0.243s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-quobyte-e88b921d-9ea9-4cb1-a118-4a302c91e5ca" released by "delete_volume" :: held 0.688s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:49 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.info" returned: 0 in 0.258s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:49 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.info is being set with open permissions: ugo+rw Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:49 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.info Sep 15 18:51:49 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Created reservations ['f4d1f286-42bc-4f73-a14d-8a2d81549c91', 'b96b15ab-0a33-43a7-b4e4-347b81a89be3', '4c70a523-c283-4b93-9f4b-c7cbcbd8abd7', '50abbb1c-c401-4e55-a17f-b74286ec5728'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:49 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:51:49 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:49 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.info" returned: 0 in 0.274s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.837s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:49 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Cloning volume 21812cd1-c9d3-444b-92fd-a33bc8fd787a to volume 127f3db6-7e9e-4ef3-9e33-948a57f28db0 Sep 15 18:51:49 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4dd14413-78a8-4cc8-89bb-16f1f82a94b7 tempest-VolumesSnapshotTestJSON-712176065 None] Create snapshot completed successfully Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Creating offline snapshot 3e3814b0-ca9f-4efd-bf67-30c7a08fc025 of volume 21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc373120-60b1-4f3a-a72b-a2607893b99f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:49 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.294s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:51:49 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Deleted volume successfully. Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-28940941-9367-41f7-899a-fb00723561d0 tempest-VolumeSnapshotQuotasNegativeTestJSON-88715870 None] Lock "cinder-e88b921d-9ea9-4cb1-a118-4a302c91e5ca-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:51:49 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a Sep 15 18:51:49 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:49 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a" returned: 0 in 0.389s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:49 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 1G Sep 15 18:51:49 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:50 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 1G" returned: 0 in 0.442s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:50 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 Sep 15 18:51:50 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:50 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025" returned: 0 in 0.366s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:50 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 is being set with open permissions: ugo+rw Sep 15 18:51:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:50 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 Sep 15 18:51:50 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:51 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025" returned: 0 in 0.402s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (f3bd662a-e691-403f-b0ac-5bb6485927cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9a47f7-dd65-44a7-8b9a-3534118d7e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.info Sep 15 18:51:51 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9a47f7-dd65-44a7-8b9a-3534118d7e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-442898465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5232a1bb-5c17-42ba-97a2-83955fc3de12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfa5559bd07f44cfb4ed60f40bf70f7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=282af960-dc3e-48ac-bb2a-129c37c9b9a5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:51Z,use_quota=True,user_id='441b0a9b12e84c1ab5036e8a1b4d5988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5431ed-20a9-4a90-93b7-ab8e777a5fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5431ed-20a9-4a90-93b7-ab8e777a5fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3780ce-9ec5-44d4-862e-240c3c7fce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3780ce-9ec5-44d4-862e-240c3c7fce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5232a1bb-5c17-42ba-97a2-83955fc3de12', 'volume_name': 'volume-5232a1bb-5c17-42ba-97a2-83955fc3de12', 'volume_size': 1, 'snapshot_id': '282af960-dc3e-48ac-bb2a-129c37c9b9a5'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf06a9ea-822b-4694-8d49-f3bbaf70243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf06a9ea-822b-4694-8d49-f3bbaf70243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beac86a9-78bb-4c78-9ad9-4d7ba7be0aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Volume 5232a1bb-5c17-42ba-97a2-83955fc3de12: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5232a1bb-5c17-42ba-97a2-83955fc3de12', 'volume_size': 1, 'snapshot_id': '282af960-dc3e-48ac-bb2a-129c37c9b9a5'} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:51 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.info" returned: 0 in 0.408s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:51 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.info is being set with open permissions: ugo+rw Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:51 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.info Sep 15 18:51:51 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:51 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.info" returned: 0 in 0.338s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Acquiring lock "cinder-quobyte-127f3db6-7e9e-4ef3-9e33-948a57f28db0" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Flow 'volume_create_manager' (dce531cf-0204-49ff-a2e6-b627a860a138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de677e36-c891-4a47-94d4-e61a2fe146d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de677e36-c891-4a47-94d4-e61a2fe146d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2080374697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56077a1f-2647-43ee-867d-78c501ac67fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927977e5d9904441855219a128b033f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:52Z,use_quota=True,user_id='8949a22e45784d3b8fb57bf337e75280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0023dcb-2d4d-414c-b8d6-6204f6856975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0023dcb-2d4d-414c-b8d6-6204f6856975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a5ff0c-8dd1-41c4-8709-9bef832cc23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a5ff0c-8dd1-41c4-8709-9bef832cc23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56077a1f-2647-43ee-867d-78c501ac67fe', 'volume_name': 'volume-56077a1f-2647-43ee-867d-78c501ac67fe', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e67082e-2a85-4d3b-a4d6-6cefd281baa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e67082e-2a85-4d3b-a4d6-6cefd281baa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f37e37-e78f-4a18-b676-6dded65f7007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:51:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Volume 56077a1f-2647-43ee-867d-78c501ac67fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56077a1f-2647-43ee-867d-78c501ac67fe', 'volume_size': 1} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Lock "cinder-quobyte-127f3db6-7e9e-4ef3-9e33-948a57f28db0" acquired by "_copy_volume_from_snapshot" :: waited 0.100s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:51:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] snapshot: 3e3814b0-ca9f-4efd-bf67-30c7a08fc025, volume: 127f3db6-7e9e-4ef3-9e33-948a57f28db0, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e6acd9-64d0-4bce-8aa5-6ab798cd9998]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:52 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 Sep 15 18:51:52 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:52 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025" returned: 0 in 0.391s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e0c36c-60ca-4fa8-950f-53b3ed626e80]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:52 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a Sep 15 18:51:52 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:51:52 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a" returned: 0 in 0.415s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 18:51:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:51:52 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 Sep 15 18:51:52 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:00 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0" returned: 0 in 7.317s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a, size 1024.00 MB, duration 7.32 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:52:00 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Converted 1024.00 MB image at 139.92 MB/s Sep 15 18:52:00 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 is being set with open permissions: ugo+rw Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:00 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 Sep 15 18:52:00 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:00 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0" returned: 0 in 0.240s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Lock "cinder-quobyte-127f3db6-7e9e-4ef3-9e33-948a57f28db0" released by "_copy_volume_from_snapshot" :: held 8.468s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=133,cinder:UPDATE=144,cinder:DELETE=8,cinder:INSERT=32 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Acquiring lock "cinder-quobyte-3e3814b0-ca9f-4efd-bf67-30c7a08fc025" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Lock "cinder-quobyte-3e3814b0-ca9f-4efd-bf67-30c7a08fc025" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Deleting offline snapshot 3e3814b0-ca9f-4efd-bf67-30c7a08fc025 of volume 21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] snapshot_file for this snap is: volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73b2b1f-b89c-4034-8920-e516770b79f7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:00 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 Sep 15 18:52:00 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:00 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025" returned: 0 in 0.357s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca8ae2b-35e9-4238-bf39-7aecd458fdf5]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:01 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a Sep 15 18:52:01 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:01 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a" returned: 0 in 0.602s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:01 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 Sep 15 18:52:01 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:01 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=133,cinder:SELECT=113,cinder:INSERT=34,cinder:DELETE=17 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:52:01 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025" returned: 0 in 0.401s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:01 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025 Sep 15 18:52:01 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:02 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a.3e3814b0-ca9f-4efd-bf67-30c7a08fc025" returned: 0 in 0.273s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Lock "cinder-quobyte-3e3814b0-ca9f-4efd-bf67-30c7a08fc025" released by "_delete_snapshot" :: held 1.744s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.904s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-282af960-dc3e-48ac-bb2a-129c37c9b9a5-5232a1bb-5c17-42ba-97a2-83955fc3de12" by "_create_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (387dbb06-e701-45b2-a07d-3bbcac46781c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0', 'volume_size': 2, 'source_volid': '21812cd1-c9d3-444b-92fd-a33bc8fd787a', 'source_volstatus': 'available'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa451c8-e232-412b-a415-9eb905433509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-282af960-dc3e-48ac-bb2a-129c37c9b9a5-5232a1bb-5c17-42ba-97a2-83955fc3de12" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Creating volume 5232a1bb-5c17-42ba-97a2-83955fc3de12 from snapshot 282af960-dc3e-48ac-bb2a-129c37c9b9a5 {{(pid=86137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-5232a1bb-5c17-42ba-97a2-83955fc3de12" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:02 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Volume volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 (127f3db6-7e9e-4ef3-9e33-948a57f28db0): created successfully Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa451c8-e232-412b-a415-9eb905433509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Flow 'volume_create_manager' (1e07a945-8789-4d56-bde9-3ac135068a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-5232a1bb-5c17-42ba-97a2-83955fc3de12" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] snapshot: 282af960-dc3e-48ac-bb2a-129c37c9b9a5, volume: 5232a1bb-5c17-42ba-97a2-83955fc3de12, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f1e7f53c-479d-4b8d-a3fd-eb41d8672a5b tempest-VolumesCloneTest-744894190 None] Created volume successfully. Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec113ce5-a861-4e7c-8377-419ecdbdd0a9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:02 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 Sep 15 18:52:02 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:02 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5" returned: 0 in 0.408s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be07d179-7815-4474-bce0-5bf402d164f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[861254aa-c1a9-46d3-9898-670ee01f2367]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:02 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 Sep 15 18:52:02 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:03 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9" returned: 0 in 0.395s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 18:52:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 18:52:03 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 18:52:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:03 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 Sep 15 18:52:03 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Acquiring lock "cinder-127f3db6-7e9e-4ef3-9e33-948a57f28db0-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Lock "cinder-127f3db6-7e9e-4ef3-9e33-948a57f28db0-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Acquiring lock "cinder-quobyte-127f3db6-7e9e-4ef3-9e33-948a57f28db0" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Lock "cinder-quobyte-127f3db6-7e9e-4ef3-9e33-948a57f28db0" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:04 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a121ff90-5a74-410e-a07a-aa9b086223e4]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:04 devstack sudo[95275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 Sep 15 18:52:04 devstack sudo[95275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:05 devstack sudo[95275]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0" returned: 0 in 0.778s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:05 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0 Sep 15 18:52:05 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:05 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-127f3db6-7e9e-4ef3-9e33-948a57f28db0" returned: 0 in 0.499s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Lock "cinder-quobyte-127f3db6-7e9e-4ef3-9e33-948a57f28db0" released by "delete_volume" :: held 1.387s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Created reservations ['da0e930b-c6ee-45a7-807a-bfec67abe218', 'f0ccac8f-8681-4b42-acd2-37ca34ef4fb2', 'a423ad42-c9b7-4972-96b3-e9159a646cb6', '62740ff2-f2bd-42ce-b548-ed0f3bf7b1e1'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:06 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:06 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:06 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.564s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Deleted volume successfully. Sep 15 18:52:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46d851b3-14b0-4321-8539-789da9b61882 tempest-VolumesCloneTest-744894190 None] Lock "cinder-127f3db6-7e9e-4ef3-9e33-948a57f28db0-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Acquiring lock "cinder-21812cd1-c9d3-444b-92fd-a33bc8fd787a-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Lock "cinder-21812cd1-c9d3-444b-92fd-a33bc8fd787a-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Acquiring lock "cinder-quobyte-21812cd1-c9d3-444b-92fd-a33bc8fd787a" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Lock "cinder-quobyte-21812cd1-c9d3-444b-92fd-a33bc8fd787a" acquired by "delete_volume" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:07 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[42635c65-760d-47d5-9cef-0fafc2305d19]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:07 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a Sep 15 18:52:07 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:07 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a" returned: 0 in 0.547s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:07 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a Sep 15 18:52:07 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:08 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-21812cd1-c9d3-444b-92fd-a33bc8fd787a" returned: 0 in 0.428s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Lock "cinder-quobyte-21812cd1-c9d3-444b-92fd-a33bc8fd787a" released by "delete_volume" :: held 1.128s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:08 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Created reservations ['8c873ee7-ecb8-471c-b096-4e0bc1447d4f', '17de8a99-54f3-4f6a-8d97-f216d6504f69', 'abe916fb-146d-43ed-99cf-4a54806a5e9c', '517fef30-9d22-4247-b8a8-e58b06c6657b'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:08 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:08 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:09 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.488s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:09 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:09 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Deleted volume successfully. Sep 15 18:52:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-127b8b87-68f2-4f54-a82b-371b8c49b17c tempest-VolumesCloneTest-744894190 None] Lock "cinder-21812cd1-c9d3-444b-92fd-a33bc8fd787a-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:12 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12" returned: 0 in 8.976s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:52:12 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Converted 1024.00 MB image at 114.07 MB/s Sep 15 18:52:12 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 is being set with open permissions: ugo+rw Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:12 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 Sep 15 18:52:12 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:12 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12" returned: 0 in 0.287s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-5232a1bb-5c17-42ba-97a2-83955fc3de12" released by "_copy_volume_from_snapshot" :: held 10.189s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-282af960-dc3e-48ac-bb2a-129c37c9b9a5-5232a1bb-5c17-42ba-97a2-83955fc3de12" released by "_create_volume_from_snapshot" :: held 10.274s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.323s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.618s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2080374697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56077a1f-2647-43ee-867d-78c501ac67fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927977e5d9904441855219a128b033f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:51:52Z,use_quota=True,user_id='8949a22e45784d3b8fb57bf337e75280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Creating volume 56077a1f-2647-43ee-867d-78c501ac67fe {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:52:12 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:12 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe 1073741824 Sep 15 18:52:12 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beac86a9-78bb-4c78-9ad9-4d7ba7be0aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5232a1bb-5c17-42ba-97a2-83955fc3de12', 'volume_size': 1, 'snapshot_id': '282af960-dc3e-48ac-bb2a-129c37c9b9a5'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c02c9b-127e-438e-8b6d-a80530f3b9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:12 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Volume volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 (5232a1bb-5c17-42ba-97a2-83955fc3de12): created successfully Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c02c9b-127e-438e-8b6d-a80530f3b9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Flow 'volume_create_manager' (f3bd662a-e691-403f-b0ac-5bb6485927cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:12 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a77fb63c-6aed-44e2-af99-b45506abe954 tempest-VolumesSnapshotTestJSON-712176065 None] Created volume successfully. Sep 15 18:52:13 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe 1073741824" returned: 0 in 0.606s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:13 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe Sep 15 18:52:13 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-5232a1bb-5c17-42ba-97a2-83955fc3de12-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-5232a1bb-5c17-42ba-97a2-83955fc3de12-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-5232a1bb-5c17-42ba-97a2-83955fc3de12" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-5232a1bb-5c17-42ba-97a2-83955fc3de12" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fbde3a-2245-4002-94b5-bf9a4f88ed5d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:13 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe" returned: 0 in 0.346s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f37e37-e78f-4a18-b676-6dded65f7007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56077a1f-2647-43ee-867d-78c501ac67fe', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ac7f5c-ac3d-4de5-8bd0-4b102e2d26cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:13 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Volume volume-56077a1f-2647-43ee-867d-78c501ac67fe (56077a1f-2647-43ee-867d-78c501ac67fe): created successfully Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ac7f5c-ac3d-4de5-8bd0-4b102e2d26cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Flow 'volume_create_manager' (dce531cf-0204-49ff-a2e6-b627a860a138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:13 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 Sep 15 18:52:13 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:13 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-12d3848f-a242-4b0f-a200-83f04222f3c1 tempest-AttachVolumeNegativeTest-522311683 None] Created volume successfully. Sep 15 18:52:14 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12" returned: 0 in 0.464s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:14 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12 Sep 15 18:52:14 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:14 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5232a1bb-5c17-42ba-97a2-83955fc3de12" returned: 0 in 0.311s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-5232a1bb-5c17-42ba-97a2-83955fc3de12" released by "delete_volume" :: held 0.843s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Created reservations ['5dbf209c-ee01-4a77-adcd-c2249aa88381', '31297a72-b439-490e-a28b-fff4c7ad657e', 'e7d0404a-4925-48bf-94e0-2b96363d8f7b', '95c9852b-8c4b-4437-acaf-9ac82ad11fdb'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:14 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:14 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:14 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.313s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Deleted volume successfully. Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-239ffed1-2e16-4b28-87e9-e52cf5732820 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-5232a1bb-5c17-42ba-97a2-83955fc3de12-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-282af960-dc3e-48ac-bb2a-129c37c9b9a5-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-282af960-dc3e-48ac-bb2a-129c37c9b9a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-be07d179-7815-4474-bce0-5bf402d164f9" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-be07d179-7815-4474-bce0-5bf402d164f9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-282af960-dc3e-48ac-bb2a-129c37c9b9a5" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-282af960-dc3e-48ac-bb2a-129c37c9b9a5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Deleting offline snapshot 282af960-dc3e-48ac-bb2a-129c37c9b9a5 of volume be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] snapshot_file for this snap is: volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc86beae-824b-4586-9122-002ec8fbd435]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:15 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 Sep 15 18:52:15 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (d0b71af6-0fbc-4cbd-be26-e95bfda5ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861a6678-58ae-4136-b4e8-e4779dde6cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861a6678-58ae-4136-b4e8-e4779dde6cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1752261030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f909d0b-65a3-4c8e-91f6-a0b73acbf038,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:15Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6575e3-48ca-4c77-aba6-2d0b7221a95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6575e3-48ca-4c77-aba6-2d0b7221a95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea396c01-ad9c-4189-974e-6413c8ff11be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea396c01-ad9c-4189-974e-6413c8ff11be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f909d0b-65a3-4c8e-91f6-a0b73acbf038', 'volume_name': 'volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d69ddf4-0597-436c-b70b-fc15f093160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d69ddf4-0597-436c-b70b-fc15f093160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528b8668-ee21-4bb6-b003-c9490b6bd9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:15 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Volume 2f909d0b-65a3-4c8e-91f6-a0b73acbf038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038', 'volume_size': 1} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1752261030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f909d0b-65a3-4c8e-91f6-a0b73acbf038,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:15Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Creating volume 2f909d0b-65a3-4c8e-91f6-a0b73acbf038 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:52:15 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:15 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 1073741824 Sep 15 18:52:15 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-753cd17a-ae06-4031-b279-a0a5207cd100 req-aef1c1ac-a746-400c-b28c-23b2b9d30be0 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:15 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5" returned: 0 in 0.587s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be07d179-7815-4474-bce0-5bf402d164f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e858ab-3390-424a-b5a0-be005cccd779]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:15 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 Sep 15 18:52:15 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:16 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 1073741824" returned: 0 in 0.633s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:16 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 Sep 15 18:52:16 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:16 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9" returned: 0 in 0.650s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:16 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 Sep 15 18:52:16 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:16 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038" returned: 0 in 0.274s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-753cd17a-ae06-4031-b279-a0a5207cd100 req-aef1c1ac-a746-400c-b28c-23b2b9d30be0 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.898s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-753cd17a-ae06-4031-b279-a0a5207cd100 req-aef1c1ac-a746-400c-b28c-23b2b9d30be0 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528b8668-ee21-4bb6-b003-c9490b6bd9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09efd8b4-2026-4c5b-b405-42ad5ccd44ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:16 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Volume volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 (2f909d0b-65a3-4c8e-91f6-a0b73acbf038): created successfully Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09efd8b4-2026-4c5b-b405-42ad5ccd44ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (d0b71af6-0fbc-4cbd-be26-e95bfda5ce50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:16 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1e03d447-34ec-4006-9180-bcdb00632971 tempest-VolumesGetTest-1492035707 None] Created volume successfully. Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-753cd17a-ae06-4031-b279-a0a5207cd100 req-aef1c1ac-a746-400c-b28c-23b2b9d30be0 tempest-AttachVolumeNegativeTest-522311683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-56077a1f-2647-43ee-867d-78c501ac67fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c75c8ed4-0ce0-4f36-8dcc-119105b12200', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:52:16 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-753cd17a-ae06-4031-b279-a0a5207cd100 req-aef1c1ac-a746-400c-b28c-23b2b9d30be0 tempest-AttachVolumeNegativeTest-522311683 None] attachment_update completed successfully. Sep 15 18:52:16 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5" returned: 0 in 0.413s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:16 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5 Sep 15 18:52:16 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:17 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9.282af960-dc3e-48ac-bb2a-129c37c9b9a5" returned: 0 in 0.326s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-282af960-dc3e-48ac-bb2a-129c37c9b9a5" released by "_delete_snapshot" :: held 2.151s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-be07d179-7815-4474-bce0-5bf402d164f9" released by "delete_snapshot" :: held 2.188s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:17 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Created reservations ['458b80ee-590b-48fe-bf10-2924fad25233', 'f66d294d-c027-4535-8b6d-9d27c2f47f99', 'a0d40ea3-3278-4545-907b-3dbb7c5719ae', '3c178536-e420-48f2-a297-d3eec52f4951'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:17 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Delete snapshot completed successfully. Sep 15 18:52:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efbe9ad3-5a19-4288-8dfe-8678b4799f9d tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-282af960-dc3e-48ac-bb2a-129c37c9b9a5-delete_snapshot" released by "delete_snapshot" :: held 2.536s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-be07d179-7815-4474-bce0-5bf402d164f9-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (3b3f9c39-1349-43ca-89fe-37a1f96f7cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fe2ada-0af5-4a4b-9974-6f7a4f144d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-be07d179-7815-4474-bce0-5bf402d164f9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fe2ada-0af5-4a4b-9974-6f7a4f144d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1618644240',display_name='tempest-VolumesGetTest-Volume-1066728475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4443e92-14b4-4e1b-bc48-bdd8f0a3276f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:18Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d06b6d0-600f-4328-9ee6-a859609e4122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d06b6d0-600f-4328-9ee6-a859609e4122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bec063-3d52-405d-bb45-cd41e98797a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bec063-3d52-405d-bb45-cd41e98797a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4443e92-14b4-4e1b-bc48-bdd8f0a3276f', 'volume_name': 'volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb06c7c-bc6d-4248-80c1-f702a2c67cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb06c7c-bc6d-4248-80c1-f702a2c67cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac42a039-d658-4561-a8d9-a11d7d32924d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:18 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Volume c4443e92-14b4-4e1b-bc48-bdd8f0a3276f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f', 'volume_size': 1} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1618644240',display_name='tempest-VolumesGetTest-Volume-1066728475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4443e92-14b4-4e1b-bc48-bdd8f0a3276f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:18Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Creating volume c4443e92-14b4-4e1b-bc48-bdd8f0a3276f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:52:18 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:18 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f 1073741824 Sep 15 18:52:18 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-be07d179-7815-4474-bce0-5bf402d164f9" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-be07d179-7815-4474-bce0-5bf402d164f9" acquired by "delete_volume" :: waited 0.039s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a1a028-acd1-4acf-ac30-17167b6c67d6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:18 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 Sep 15 18:52:18 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:19 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9" returned: 0 in 0.574s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:19 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9 Sep 15 18:52:19 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:19 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f 1073741824" returned: 0 in 0.799s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:19 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f Sep 15 18:52:19 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:19 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be07d179-7815-4474-bce0-5bf402d164f9" returned: 0 in 0.351s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-be07d179-7815-4474-bce0-5bf402d164f9" released by "delete_volume" :: held 1.041s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:19 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f" returned: 0 in 0.322s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:19 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-e7488791-5cc7-4fbe-97c1-f834c809f96a req-c6e22e2e-fc7b-4731-a453-264e09094cdb tempest-AttachVolumeNegativeTest-522311683 None] Terminate volume connection completed successfully. Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-e7488791-5cc7-4fbe-97c1-f834c809f96a req-c6e22e2e-fc7b-4731-a453-264e09094cdb tempest-AttachVolumeNegativeTest-522311683 None] Deleting attachment c75c8ed4-0ce0-4f36-8dcc-119105b12200. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac42a039-d658-4561-a8d9-a11d7d32924d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1e77ed-cf60-4f24-a137-a0bdba22fa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:19 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Volume volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f (c4443e92-14b4-4e1b-bc48-bdd8f0a3276f): created successfully Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1e77ed-cf60-4f24-a137-a0bdba22fa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (3b3f9c39-1349-43ca-89fe-37a1f96f7cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Created reservations ['e7c28e04-a6a8-4735-8cfb-adc3ead19034', '94e39319-ba3b-408a-82f2-70dd147d485e', '002fe7f8-fffc-4981-a9db-798ddc753bd9', 'b433c344-b04b-4a55-ba4b-bd9740956ac9'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:19 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9196f0a3-babc-4368-b2bf-7d2f8b7ae8cd tempest-VolumesGetTest-1492035707 None] Created volume successfully. Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:20 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:20 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:20 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.278s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:20 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Deleted volume successfully. Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1609c644-a6a8-4050-b500-76502c5315c4 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-be07d179-7815-4474-bce0-5bf402d164f9-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Lock "cinder-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-quobyte-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8070eba5-42ef-4d8f-adc2-1ea1dd1c0c5b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "cinder-quobyte-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" acquired by "delete_volume" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:21 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f Sep 15 18:52:21 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:21 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bd1d1b-245c-4d39-a7be-4d6e44a94ca7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:21 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 Sep 15 18:52:21 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:21 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f" returned: 0 in 0.733s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:21 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f Sep 15 18:52:21 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:21 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" returned: 0 in 0.650s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:21 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3 Sep 15 18:52:21 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:21 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f" returned: 0 in 0.409s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f" released by "delete_volume" :: held 1.244s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Created reservations ['630ef55c-ac52-4b70-82d5-04d439668a19', '98d499c0-a27e-4403-822d-3f733a7b97b7', 'c4ab2bb1-2f78-45d9-8762-686f23373e33', '6a82a256-37c0-42c7-82fe-273cd3464989'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:22 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" returned: 0 in 0.393s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-quobyte-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3" released by "delete_volume" :: held 1.209s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:22 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:22 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Created reservations ['5e4fb72c-a178-4bf4-8749-6f52cd3675e3', 'e0ef6340-6a1c-4924-88c3-bd51a4adc82d', '608bfe24-c2d8-479b-bf75-f17a713226c1', 'a76b7bcb-e98d-487f-a3a1-6c468a0b8dba'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:22 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:22 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:22 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.317s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:22 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Deleted volume successfully. Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb90030c-9528-40c1-aaff-5622985e07e8 tempest-VolumesGetTest-1492035707 None] Lock "cinder-c4443e92-14b4-4e1b-bc48-bdd8f0a3276f-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:22 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.399s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:22 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Deleted volume successfully. Sep 15 18:52:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-151f502d-1857-44b5-a218-6f327411a1c8 tempest-VolumesSnapshotTestJSON-712176065 None] Lock "cinder-be3ceadf-803b-4c13-9ab2-011cd5c3d0a3-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-2f909d0b-65a3-4c8e-91f6-a0b73acbf038-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Lock "cinder-2f909d0b-65a3-4c8e-91f6-a0b73acbf038-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-quobyte-2f909d0b-65a3-4c8e-91f6-a0b73acbf038" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-2f909d0b-65a3-4c8e-91f6-a0b73acbf038" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:23 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a20289b-a4f3-43a7-b61d-7d889fcc0fe1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:23 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 Sep 15 18:52:23 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:23 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038" returned: 0 in 0.626s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:23 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038 Sep 15 18:52:23 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:24 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2f909d0b-65a3-4c8e-91f6-a0b73acbf038" returned: 0 in 0.334s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-2f909d0b-65a3-4c8e-91f6-a0b73acbf038" released by "delete_volume" :: held 1.053s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Created reservations ['333993e9-54e7-4b95-a539-4eb6ac4c848d', 'b3321540-1ca3-42c2-bcda-613bb9f6f1bd', 'f141f119-f49f-4cbf-8ce1-599bc18d0659', '638b237c-65d3-40bc-8dd9-5e3eea55e7aa'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:24 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:24 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:24 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.267s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:24 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Deleted volume successfully. Sep 15 18:52:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-596152cf-58af-4504-897e-cd6d62c33d1f tempest-VolumesGetTest-1492035707 None] Lock "cinder-2f909d0b-65a3-4c8e-91f6-a0b73acbf038-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (6f9282c7-2980-45a3-a8ec-8aa758538cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ed5aab-2245-432e-bc8b-7b63a51ee059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ed5aab-2245-432e-bc8b-7b63a51ee059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1149282022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864d34fc-b123-4ba9-8b55-6eef550c1ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:26Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3797f16-878a-42ba-aee9-1a5885f9c1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3797f16-878a-42ba-aee9-1a5885f9c1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170c39f8-dbec-44d0-be52-88ee188fc1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170c39f8-dbec-44d0-be52-88ee188fc1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864d34fc-b123-4ba9-8b55-6eef550c1ede', 'volume_name': 'volume-864d34fc-b123-4ba9-8b55-6eef550c1ede', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d8d7d1-a980-4c1e-b33f-a6c8a7c0abd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d8d7d1-a980-4c1e-b33f-a6c8a7c0abd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4312c356-1b61-4b33-a249-41d7c27ba0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:26 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Volume 864d34fc-b123-4ba9-8b55-6eef550c1ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864d34fc-b123-4ba9-8b55-6eef550c1ede', 'volume_size': 1} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1149282022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864d34fc-b123-4ba9-8b55-6eef550c1ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:26Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Creating volume 864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:52:26 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:26 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede 1073741824 Sep 15 18:52:26 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:26 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede 1073741824" returned: 0 in 0.602s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:26 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede Sep 15 18:52:26 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:27 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede" returned: 0 in 0.319s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:52:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4312c356-1b61-4b33-a249-41d7c27ba0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864d34fc-b123-4ba9-8b55-6eef550c1ede', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afa743b-c32e-4bc3-b636-1a9d3c2e8053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:27 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Volume volume-864d34fc-b123-4ba9-8b55-6eef550c1ede (864d34fc-b123-4ba9-8b55-6eef550c1ede): created successfully Sep 15 18:52:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afa743b-c32e-4bc3-b636-1a9d3c2e8053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (6f9282c7-2980-45a3-a8ec-8aa758538cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:27 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a5a6e2ae-02e0-466d-9f6c-5e2dc7a05f69 tempest-VolumesGetTest-1492035707 None] Created volume successfully. Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (e14dca55-bd30-409e-ab42-545c6f4ad407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01151dd3-f6d9-4f04-807c-157e832d6e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01151dd3-f6d9-4f04-807c-157e832d6e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2054946846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3a86c0-77e5-4b03-af74-b118058634fe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=864d34fc-b123-4ba9-8b55-6eef550c1ede,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:29Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69e836d-af3b-4591-82bf-609c8b53b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69e836d-af3b-4591-82bf-609c8b53b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f42b0a-2721-421b-b144-5d44c1b86a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f42b0a-2721-421b-b144-5d44c1b86a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ee3a86c0-77e5-4b03-af74-b118058634fe', 'volume_name': 'volume-ee3a86c0-77e5-4b03-af74-b118058634fe', 'volume_size': 1, 'source_volid': '864d34fc-b123-4ba9-8b55-6eef550c1ede', 'source_volstatus': 'available'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8830e7a5-3da5-463f-ab50-55a899a0d7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8830e7a5-3da5-463f-ab50-55a899a0d7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3884fda7-667d-479e-b2df-ba9ab85059f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:28 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Volume ee3a86c0-77e5-4b03-af74-b118058634fe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ee3a86c0-77e5-4b03-af74-b118058634fe', 'volume_size': 1, 'source_volid': '864d34fc-b123-4ba9-8b55-6eef550c1ede', 'source_volstatus': 'available'} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:28 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Cloning volume 864d34fc-b123-4ba9-8b55-6eef550c1ede to volume ee3a86c0-77e5-4b03-af74-b118058634fe Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Creating offline snapshot e3c41095-5a4a-43c9-ab96-e17c7215cbc3 of volume 864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ba36cf-971e-49e1-b959-f41239d5e253]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:28 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede Sep 15 18:52:29 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:29 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede" returned: 0 in 0.455s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:29 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 1G Sep 15 18:52:29 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:29 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 1G" returned: 0 in 0.566s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864d34fc-b123-4ba9-8b55-6eef550c1ede -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:29 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864d34fc-b123-4ba9-8b55-6eef550c1ede -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 Sep 15 18:52:29 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:30 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864d34fc-b123-4ba9-8b55-6eef550c1ede -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3" returned: 0 in 0.389s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:30 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 is being set with open permissions: ugo+rw Sep 15 18:52:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:30 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 Sep 15 18:52:30 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:30 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3" returned: 0 in 0.608s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:31 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.info Sep 15 18:52:31 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:31 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.info" returned: 0 in 0.515s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:31 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.info is being set with open permissions: ugo+rw Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:31 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.info Sep 15 18:52:31 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:31 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.info" returned: 0 in 0.395s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-quobyte-ee3a86c0-77e5-4b03-af74-b118058634fe" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-ee3a86c0-77e5-4b03-af74-b118058634fe" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] snapshot: e3c41095-5a4a-43c9-ab96-e17c7215cbc3, volume: ee3a86c0-77e5-4b03-af74-b118058634fe, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:32 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b70adbe-000f-4b0c-97d8-2bec4e90367b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:32 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 Sep 15 18:52:32 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:32 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3" returned: 0 in 0.705s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-864d34fc-b123-4ba9-8b55-6eef550c1ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:52:32 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2935775-4267-4235-be44-40ef2cabe95e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:32 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede Sep 15 18:52:32 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:33 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede" returned: 0 in 0.625s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 18:52:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 18:52:33 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 18:52:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:33 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe Sep 15 18:52:33 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (d5de683e-67a4-4490-94fe-4421ee50acee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcfd9be-5691-461e-8253-48755d13069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abcfd9be-5691-461e-8253-48755d13069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2071044139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbe1c9a-306b-454c-b55d-fb81b922078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:36Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e026f943-8e72-477b-a217-1c8225fc7d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e026f943-8e72-477b-a217-1c8225fc7d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d2036d-4271-4d8f-aac3-9a4d4b36a3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d2036d-4271-4d8f-aac3-9a4d4b36a3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cbe1c9a-306b-454c-b55d-fb81b922078d', 'volume_name': 'volume-5cbe1c9a-306b-454c-b55d-fb81b922078d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e6d5b5-5f8d-4f23-84a6-3ff1b6e80854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17e6d5b5-5f8d-4f23-84a6-3ff1b6e80854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5b83d2-6f19-4322-8a88-c1d49a2fe990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:36 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Volume 5cbe1c9a-306b-454c-b55d-fb81b922078d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cbe1c9a-306b-454c-b55d-fb81b922078d', 'volume_size': 1} Sep 15 18:52:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:39 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:52:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Flow 'volume_create_manager' (304e59ac-d491-424a-b6fd-ba9ec8ffca8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7291ff7-bf38-435a-94d8-eec77f7075cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7291ff7-bf38-435a-94d8-eec77f7075cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1427385396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09557146-5021-4eef-b3aa-42046754d32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6313a81b6ebf4a2995b3b998bea2c4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:40Z,use_quota=True,user_id='e5b43b1954064221886aaefb1d8f509a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07796a12-9228-448e-bea8-d2c1815f6342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07796a12-9228-448e-bea8-d2c1815f6342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105273de-f5f4-48c9-a061-1a5885a233c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (105273de-f5f4-48c9-a061-1a5885a233c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09557146-5021-4eef-b3aa-42046754d32c', 'volume_name': 'volume-09557146-5021-4eef-b3aa-42046754d32c', 'volume_size': 2}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776d81b9-abf6-48ea-afea-65bd0026220a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776d81b9-abf6-48ea-afea-65bd0026220a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72ef662-f806-48b4-9826-19a870231091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:40 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Volume 09557146-5021-4eef-b3aa-42046754d32c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09557146-5021-4eef-b3aa-42046754d32c', 'volume_size': 2} Sep 15 18:52:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe" returned: 0 in 11.493s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:44 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede, size 1024.00 MB, duration 11.49 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:52:44 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Converted 1024.00 MB image at 89.09 MB/s Sep 15 18:52:44 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe is being set with open permissions: ugo+rw Sep 15 18:52:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:44 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe Sep 15 18:52:44 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:45 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe" returned: 0 in 0.316s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-ee3a86c0-77e5-4b03-af74-b118058634fe" released by "_copy_volume_from_snapshot" :: held 13.270s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-quobyte-e3c41095-5a4a-43c9-ab96-e17c7215cbc3" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-e3c41095-5a4a-43c9-ab96-e17c7215cbc3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Deleting offline snapshot e3c41095-5a4a-43c9-ab96-e17c7215cbc3 of volume 864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] snapshot_file for this snap is: volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96036f9-2826-4c8a-b6b3-fcdb5c625953]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:45 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 Sep 15 18:52:45 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:45 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:45 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:45 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3" returned: 0 in 0.686s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-864d34fc-b123-4ba9-8b55-6eef550c1ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:52:46 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a419dc-18a6-4ec0-bd72-9c32a9a6c03a]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:46 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.411s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:52:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 28 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:52:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:52:46 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede Sep 15 18:52:46 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:46 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede" returned: 0 in 0.915s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:47 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 Sep 15 18:52:47 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:47 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3" returned: 0 in 0.416s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:47 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3 Sep 15 18:52:47 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:47 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede.e3c41095-5a4a-43c9-ab96-e17c7215cbc3" returned: 0 in 0.259s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-e3c41095-5a4a-43c9-ab96-e17c7215cbc3" released by "_delete_snapshot" :: held 2.461s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.934s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.958s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2071044139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cbe1c9a-306b-454c-b55d-fb81b922078d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:36Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Creating volume 5cbe1c9a-306b-454c-b55d-fb81b922078d {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:52:47 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:47 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d 1073741824 Sep 15 18:52:47 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3884fda7-667d-479e-b2df-ba9ab85059f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3a86c0-77e5-4b03-af74-b118058634fe', 'volume_size': 1, 'source_volid': '864d34fc-b123-4ba9-8b55-6eef550c1ede', 'source_volstatus': 'available'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfecd6ee-c275-489a-ba60-259bb903edf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:47 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Volume volume-ee3a86c0-77e5-4b03-af74-b118058634fe (ee3a86c0-77e5-4b03-af74-b118058634fe): created successfully Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfecd6ee-c275-489a-ba60-259bb903edf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (e14dca55-bd30-409e-ab42-545c6f4ad407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-93d325c6-63b1-47bc-b986-69ae6d4bd967 tempest-VolumesGetTest-1492035707 None] Created volume successfully. Sep 15 18:52:48 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d 1073741824" returned: 0 in 0.552s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:48 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d Sep 15 18:52:48 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:48 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d" returned: 0 in 0.343s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.553s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1427385396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09557146-5021-4eef-b3aa-42046754d32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6313a81b6ebf4a2995b3b998bea2c4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:40Z,use_quota=True,user_id='e5b43b1954064221886aaefb1d8f509a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Creating volume 09557146-5021-4eef-b3aa-42046754d32c {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:52:48 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c 2147483648 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:48 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c 2147483648 Sep 15 18:52:48 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc5b83d2-6f19-4322-8a88-c1d49a2fe990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cbe1c9a-306b-454c-b55d-fb81b922078d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7558be23-8f19-4cbb-b30a-497d95b1ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:48 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Volume volume-5cbe1c9a-306b-454c-b55d-fb81b922078d (5cbe1c9a-306b-454c-b55d-fb81b922078d): created successfully Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7558be23-8f19-4cbb-b30a-497d95b1ac29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (d5de683e-67a4-4490-94fe-4421ee50acee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:48 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9202f1c0-cdc5-435b-9aa8-759e60c9484a tempest-VolumesActionsTest-1759082154 None] Created volume successfully. Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (83a60ca1-4f34-46a6-95b5-bec49c6244cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616c5a5c-a5e4-4d76-b288-642d211ee12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616c5a5c-a5e4-4d76-b288-642d211ee12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-864614730',display_name='tempest-VolumesGetTest-Volume-896299734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169b4eeb-6962-4787-b01b-b45ba7a57b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:49Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdea7a3a-39b7-4e88-a756-f5cdf8ff39c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdea7a3a-39b7-4e88-a756-f5cdf8ff39c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b686bc-cf20-4db0-bc1d-26bd020142f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b686bc-cf20-4db0-bc1d-26bd020142f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '169b4eeb-6962-4787-b01b-b45ba7a57b38', 'volume_name': 'volume-169b4eeb-6962-4787-b01b-b45ba7a57b38', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d11a3f9-0a30-4ae8-8429-b321a1b49bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d11a3f9-0a30-4ae8-8429-b321a1b49bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8259d9f2-f2ae-4095-846b-f0139f273ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:49 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Volume 169b4eeb-6962-4787-b01b-b45ba7a57b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-169b4eeb-6962-4787-b01b-b45ba7a57b38', 'volume_size': 1} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:49 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c 2147483648" returned: 0 in 0.718s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:49 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c Sep 15 18:52:49 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a0026190-d4a1-4006-b89c-0cb697bee4cf tempest-VolumesActionsTest-1759082154 None] Acquiring lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d" by "attach_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a0026190-d4a1-4006-b89c-0cb697bee4cf tempest-VolumesActionsTest-1759082154 None] Lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d" acquired by "attach_volume" :: waited 0.039s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:49 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c" returned: 0 in 0.389s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.529s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-864614730',display_name='tempest-VolumesGetTest-Volume-896299734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=169b4eeb-6962-4787-b01b-b45ba7a57b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:49Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Creating volume 169b4eeb-6962-4787-b01b-b45ba7a57b38 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:52:49 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72ef662-f806-48b4-9826-19a870231091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09557146-5021-4eef-b3aa-42046754d32c', 'volume_size': 2}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9520ef10-1ffd-4fe4-8421-67640bb17780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:49 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 1073741824 Sep 15 18:52:49 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a0026190-d4a1-4006-b89c-0cb697bee4cf tempest-VolumesActionsTest-1759082154 None] Attaching volume 5cbe1c9a-306b-454c-b55d-fb81b922078d to instance 9333d2bc-c0f5-4b02-80d1-2cb25761be63 at mountpoint /dev/vdb on host None. Sep 15 18:52:50 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Volume volume-09557146-5021-4eef-b3aa-42046754d32c (09557146-5021-4eef-b3aa-42046754d32c): created successfully Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9520ef10-1ffd-4fe4-8421-67640bb17780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Flow 'volume_create_manager' (304e59ac-d491-424a-b6fd-ba9ec8ffca8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-07a1f012-7648-4d17-841e-65d978668a17 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Created volume successfully. Sep 15 18:52:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a0026190-d4a1-4006-b89c-0cb697bee4cf tempest-VolumesActionsTest-1759082154 None] Attach volume completed successfully. Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a0026190-d4a1-4006-b89c-0cb697bee4cf tempest-VolumesActionsTest-1759082154 None] Lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d" released by "attach_volume" :: held 0.282s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:50 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 1073741824" returned: 0 in 0.586s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:50 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 Sep 15 18:52:50 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1cf0d473-7cff-406e-ad00-aaa351dc5075 tempest-VolumesActionsTest-48180588 None] Terminate volume connection completed successfully. Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1cf0d473-7cff-406e-ad00-aaa351dc5075 tempest-VolumesActionsTest-48180588 None] Acquiring lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d-detach_volume" by "detach_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:50 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38" returned: 0 in 0.276s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1cf0d473-7cff-406e-ad00-aaa351dc5075 tempest-VolumesActionsTest-48180588 None] Lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8259d9f2-f2ae-4095-846b-f0139f273ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-169b4eeb-6962-4787-b01b-b45ba7a57b38', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee19c49-d13f-4149-95e5-2828e3404a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1cf0d473-7cff-406e-ad00-aaa351dc5075 tempest-VolumesActionsTest-48180588 None] Detaching volume 5cbe1c9a-306b-454c-b55d-fb81b922078d from instance 9333d2bc-c0f5-4b02-80d1-2cb25761be63. Sep 15 18:52:50 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Volume volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 (169b4eeb-6962-4787-b01b-b45ba7a57b38): created successfully Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee19c49-d13f-4149-95e5-2828e3404a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (83a60ca1-4f34-46a6-95b5-bec49c6244cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-41ba35e5-75ad-42a2-b14e-38695e9e9996 tempest-VolumesGetTest-1492035707 None] Created volume successfully. Sep 15 18:52:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1cf0d473-7cff-406e-ad00-aaa351dc5075 tempest-VolumesActionsTest-48180588 None] Detach volume completed successfully. Sep 15 18:52:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1cf0d473-7cff-406e-ad00-aaa351dc5075 tempest-VolumesActionsTest-48180588 None] Lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d-detach_volume" released by "detach_volume" :: held 0.114s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c9d96a3c-43c0-4d60-a449-926e0e110246 tempest-VolumesActionsTest-1759082154 None] Acquiring lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d-detach_volume" by "detach_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c9d96a3c-43c0-4d60-a449-926e0e110246 tempest-VolumesActionsTest-1759082154 None] Lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c9d96a3c-43c0-4d60-a449-926e0e110246 tempest-VolumesActionsTest-1759082154 None] Volume detach called, but volume not attached. Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c9d96a3c-43c0-4d60-a449-926e0e110246 tempest-VolumesActionsTest-1759082154 None] Lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Creating offline snapshot 9fb6bc34-1687-4c38-969f-20e3e5f1746a of volume 09557146-5021-4eef-b3aa-42046754d32c {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1d8729-f569-4457-baf8-e70d3d43d786]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Acquiring lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:51 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-169b4eeb-6962-4787-b01b-b45ba7a57b38-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:51 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Lock "cinder-169b4eeb-6962-4787-b01b-b45ba7a57b38-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Acquiring lock "cinder-quobyte-5cbe1c9a-306b-454c-b55d-fb81b922078d" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Lock "cinder-quobyte-5cbe1c9a-306b-454c-b55d-fb81b922078d" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18800c3-f45d-4416-8dd8-3a6694d00fba]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-quobyte-169b4eeb-6962-4787-b01b-b45ba7a57b38" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-169b4eeb-6962-4787-b01b-b45ba7a57b38" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ea7841-2cf1-4053-be4b-d4a5e5dc3132]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:51 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d Sep 15 18:52:51 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:51 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 Sep 15 18:52:51 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:51 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c" returned: 0 in 0.530s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a 2G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:51 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a 2G Sep 15 18:52:51 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:52 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d" returned: 0 in 0.452s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:52 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38" returned: 0 in 0.411s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:52 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d Sep 15 18:52:52 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:52 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38 Sep 15 18:52:52 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:52 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a 2G" returned: 0 in 0.493s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09557146-5021-4eef-b3aa-42046754d32c -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:52 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09557146-5021-4eef-b3aa-42046754d32c -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a Sep 15 18:52:52 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:52 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-169b4eeb-6962-4787-b01b-b45ba7a57b38" returned: 0 in 0.325s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-169b4eeb-6962-4787-b01b-b45ba7a57b38" released by "delete_volume" :: held 0.798s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:52 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5cbe1c9a-306b-454c-b55d-fb81b922078d" returned: 0 in 0.383s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Lock "cinder-quobyte-5cbe1c9a-306b-454c-b55d-fb81b922078d" released by "delete_volume" :: held 0.908s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Created reservations ['cfafe35a-454c-428e-9b81-adfda7d76284', '98a338c3-ff71-4a7b-a935-fb485489080c', 'bffc0402-9795-4a03-8251-5954ee3295e1', '0e7f46a0-6805-4208-a2d0-8e87c831d682'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Created reservations ['dd03856d-acd8-4044-864c-92498d4ecf86', 'f9561bf0-19d7-462c-b769-a3fc6369e4f6', '0547a911-6ee9-4c56-a8bb-8d1dcc1a81e1', '9e383eac-fad6-4871-a6d8-6bc11b22eef3'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:52 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:52 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:52 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09557146-5021-4eef-b3aa-42046754d32c -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a" returned: 0 in 0.551s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:52 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a is being set with open permissions: ugo+rw Sep 15 18:52:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:52 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:52 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-ee3a86c0-77e5-4b03-af74-b118058634fe-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:53 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a Sep 15 18:52:53 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Lock "cinder-ee3a86c0-77e5-4b03-af74-b118058634fe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-quobyte-ee3a86c0-77e5-4b03-af74-b118058634fe" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-ee3a86c0-77e5-4b03-af74-b118058634fe" acquired by "delete_volume" :: waited 0.048s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53d2360-c65b-432a-8510-6335b4463492]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:53 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:53 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.571s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.510s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:53 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Deleted volume successfully. Sep 15 18:52:53 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe Sep 15 18:52:53 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-df8e30d8-43e4-4a5f-9b3d-dede176a4008 tempest-VolumesGetTest-1492035707 None] Lock "cinder-169b4eeb-6962-4787-b01b-b45ba7a57b38-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:53 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Deleted volume successfully. Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f733ce32-77a9-425d-97f9-fbd41e7ab939 tempest-VolumesActionsTest-1759082154 None] Lock "cinder-5cbe1c9a-306b-454c-b55d-fb81b922078d-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:53 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a" returned: 0 in 0.659s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:53 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.info Sep 15 18:52:53 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:53 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe" returned: 0 in 0.489s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:53 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe Sep 15 18:52:53 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:54 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.info" returned: 0 in 0.402s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:54 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.info is being set with open permissions: ugo+rw Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:54 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.info Sep 15 18:52:54 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:54 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee3a86c0-77e5-4b03-af74-b118058634fe" returned: 0 in 0.500s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-ee3a86c0-77e5-4b03-af74-b118058634fe" released by "delete_volume" :: held 1.142s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Created reservations ['89e77734-6f62-43d3-b535-4c294480f711', '344aca56-b5cd-415e-af4d-69d5850c10f9', '97a52eaf-fd69-4d4e-852c-9ec5d51da620', '752a5277-2f96-4681-80a8-f6f23c5a873a'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:54 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.info" returned: 0 in 0.516s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.307s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-02f17243-0af5-4633-9cc5-6da142e5ccf5 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Create snapshot completed successfully Sep 15 18:52:54 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:54 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:55 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.419s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Deleted volume successfully. Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b650bf5e-12c5-4413-b36a-de92773941db tempest-VolumesGetTest-1492035707 None] Lock "cinder-ee3a86c0-77e5-4b03-af74-b118058634fe-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-864d34fc-b123-4ba9-8b55-6eef550c1ede-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Lock "cinder-864d34fc-b123-4ba9-8b55-6eef550c1ede-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-quobyte-864d34fc-b123-4ba9-8b55-6eef550c1ede" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Acquiring lock "cinder-9fb6bc34-1687-4c38-969f-20e3e5f1746a-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-864d34fc-b123-4ba9-8b55-6eef550c1ede" acquired by "delete_volume" :: waited 0.087s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-9fb6bc34-1687-4c38-969f-20e3e5f1746a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.106s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Acquiring lock "cinder-quobyte-09557146-5021-4eef-b3aa-42046754d32c" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-quobyte-09557146-5021-4eef-b3aa-42046754d32c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Acquiring lock "cinder-quobyte-9fb6bc34-1687-4c38-969f-20e3e5f1746a" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b4d150-74bd-4994-8bff-fd9cbd04eb5e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-quobyte-9fb6bc34-1687-4c38-969f-20e3e5f1746a" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Deleting offline snapshot 9fb6bc34-1687-4c38-969f-20e3e5f1746a of volume 09557146-5021-4eef-b3aa-42046754d32c {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] snapshot_file for this snap is: volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b558bdb-ab09-46d5-ab90-9c7c1f7861e9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:56 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede Sep 15 18:52:56 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:56 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a Sep 15 18:52:56 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:56 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede" returned: 0 in 0.609s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:56 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede Sep 15 18:52:56 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:56 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a" returned: 0 in 0.546s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09557146-5021-4eef-b3aa-42046754d32c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b391be00-9d37-40f9-8cce-27de861f73fb]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:56 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c Sep 15 18:52:56 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:56 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-864d34fc-b123-4ba9-8b55-6eef550c1ede" returned: 0 in 0.363s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-864d34fc-b123-4ba9-8b55-6eef550c1ede" released by "delete_volume" :: held 1.085s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Created reservations ['8db81940-e8e2-47c7-9a1d-163b87952a37', 'bb25197d-44fa-42ce-908d-6d2343beb274', '6a5dc504-76d5-4c9e-a1a0-a316aafda48c', '0be3fc8d-a951-4824-8686-ed38efa4a4ef'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:57 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:52:57 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:57 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c" returned: 0 in 0.513s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:57 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a Sep 15 18:52:57 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:57 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.304s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:52:57 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Deleted volume successfully. Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0f9d6ade-63bf-4673-b695-0f72e45747f2 tempest-VolumesGetTest-1492035707 None] Lock "cinder-864d34fc-b123-4ba9-8b55-6eef550c1ede-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:57 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a" returned: 0 in 0.451s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:57 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a Sep 15 18:52:57 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:57 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:52:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (68330a9f-64b8-44ca-9b82-65f994675e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cb9506-a180-441a-9353-c6d013e8a2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c.9fb6bc34-1687-4c38-969f-20e3e5f1746a" returned: 0 in 0.395s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cb9506-a180-441a-9353-c6d013e8a2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483848481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678349de-f4be-4aa4-975a-1e9fc381c41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:58Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7836c7cd-b059-4a7d-80ec-8ce82c9554be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7836c7cd-b059-4a7d-80ec-8ce82c9554be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c75c2f-83f9-405c-9ae7-aadfbfee92a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51c75c2f-83f9-405c-9ae7-aadfbfee92a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678349de-f4be-4aa4-975a-1e9fc381c41c', 'volume_name': 'volume-678349de-f4be-4aa4-975a-1e9fc381c41c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3cfd22e-5168-4bdc-aee2-b784cbcbfdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3cfd22e-5168-4bdc-aee2-b784cbcbfdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc3fbb7-7575-45f8-844f-ac15bb817de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:58 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Volume 678349de-f4be-4aa4-975a-1e9fc381c41c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678349de-f4be-4aa4-975a-1e9fc381c41c', 'volume_size': 1} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-483848481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678349de-f4be-4aa4-975a-1e9fc381c41c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:58Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Creating volume 678349de-f4be-4aa4-975a-1e9fc381c41c {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:52:58 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-quobyte-9fb6bc34-1687-4c38-969f-20e3e5f1746a" released by "_delete_snapshot" :: held 2.163s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-quobyte-09557146-5021-4eef-b3aa-42046754d32c" released by "delete_snapshot" :: held 2.226s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:58 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c 1073741824 Sep 15 18:52:58 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Created reservations ['abc33242-5689-45b6-8ee7-ba38bac00eb8', 'f97a11db-7e02-418f-aa87-5244cfb7218f', '3b6908ad-3deb-4770-bf3b-acbefd411c95', 'dcc11ea7-8c94-4df4-833c-00404d37aebc'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:52:58 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Delete snapshot completed successfully. Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6b773c25-1c41-4177-8ae5-d544c9467069 tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-9fb6bc34-1687-4c38-969f-20e3e5f1746a-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:52:58 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c 1073741824" returned: 0 in 0.603s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:58 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c Sep 15 18:52:58 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (4cf6b1c8-ebbd-4145-b0e1-c445840c336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae8eda5-b833-4db2-86c8-49c913f1a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae8eda5-b833-4db2-86c8-49c913f1a20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1462949888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2fe520-f07d-4109-b096-813320ca8198,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:59Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ee134c-d162-4f40-bf20-bca48f2045de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ee134c-d162-4f40-bf20-bca48f2045de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffe1026-8e40-48dd-939f-a7a28654e852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 18:52:59 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c" returned: 0 in 0.434s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc3fbb7-7575-45f8-844f-ac15bb817de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678349de-f4be-4aa4-975a-1e9fc381c41c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616fc97c-5df4-4f17-b412-89dfb3e254c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Acquiring lock "cinder-09557146-5021-4eef-b3aa-42046754d32c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Volume volume-678349de-f4be-4aa4-975a-1e9fc381c41c (678349de-f4be-4aa4-975a-1e9fc381c41c): created successfully Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616fc97c-5df4-4f17-b412-89dfb3e254c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (68330a9f-64b8-44ca-9b82-65f994675e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-09557146-5021-4eef-b3aa-42046754d32c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:59 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6f2eb6fa-bfe2-4bdb-92be-36a61592949c tempest-VolumesActionsTest-1759082154 None] Created volume successfully. Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Acquiring lock "cinder-quobyte-09557146-5021-4eef-b3aa-42046754d32c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-quobyte-09557146-5021-4eef-b3aa-42046754d32c" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95c3064-9f7f-4d0e-8642-ddbd4abd194c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:59 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c Sep 15 18:52:59 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffe1026-8e40-48dd-939f-a7a28654e852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e2fe520-f07d-4109-b096-813320ca8198', 'volume_name': 'volume-2e2fe520-f07d-4109-b096-813320ca8198', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5177ad8b-0b7e-4cdb-80fb-1152efb96aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5177ad8b-0b7e-4cdb-80fb-1152efb96aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de7d4f4-0d96-46d7-8772-c4bb629a77bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:52:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Volume 2e2fe520-f07d-4109-b096-813320ca8198: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e2fe520-f07d-4109-b096-813320ca8198', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Trying to clone 2e2fe520-f07d-4109-b096-813320ca8198 from image cb9e9155-abe1-4ceb-8a92-39c0a579534a at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 18:52:59 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c" returned: 0 in 0.428s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:52:59 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c Sep 15 18:52:59 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:52:59 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 18:52:59 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Image download 20.69 MB at 20.69 MB/s Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f63c53d-6a82-4a9c-9f44-8d0f1f5e9cd0]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:00 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09557146-5021-4eef-b3aa-42046754d32c" returned: 0 in 0.398s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-quobyte-09557146-5021-4eef-b3aa-42046754d32c" released by "delete_volume" :: held 0.906s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:00 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD Sep 15 18:53:00 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Created reservations ['0a9da964-4591-4241-9c2f-a0699e9b773e', '7bbf12c2-33e5-46e4-a0b7-56ffaabaa482', '535669b2-d35b-446d-8b09-71ab16fe017f', 'b0abaf0b-5bd6-4916-ae7f-ee4b34857082'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Acquiring lock "cinder-678349de-f4be-4aa4-975a-1e9fc381c41c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Lock "cinder-678349de-f4be-4aa4-975a-1e9fc381c41c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:00 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:00 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Acquiring lock "cinder-quobyte-678349de-f4be-4aa4-975a-1e9fc381c41c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Lock "cinder-quobyte-678349de-f4be-4aa4-975a-1e9fc381c41c" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:00 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba147cf-3ad4-492b-a293-158d1d177767]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD" returned: 0 in 0.520s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a is fetched for user b9408c5e58e14eb4bb57e81e1d06192c. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=153,cinder:SELECT=109,cinder:INSERT=38,cinder:DELETE=15 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[502a8cfb-95a7-48dd-b2d8-76a85e405da3]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:00 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c Sep 15 18:53:00 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:00 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.293s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:00 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD Sep 15 18:53:00 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Deleted volume successfully. Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf4d230c-2885-461e-9e30-b3da22a2b6ad tempest-VolumesSnapshotNegativeTestJSON-208755671 None] Lock "cinder-09557146-5021-4eef-b3aa-42046754d32c-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:00 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c" returned: 0 in 0.405s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:01 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c Sep 15 18:53:01 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:01 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1462949888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e2fe520-f07d-4109-b096-813320ca8198,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:52:59Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Creating volume 2e2fe520-f07d-4109-b096-813320ca8198 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:01 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:01 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 1073741824 Sep 15 18:53:01 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:01 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-678349de-f4be-4aa4-975a-1e9fc381c41c" returned: 0 in 0.268s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Lock "cinder-quobyte-678349de-f4be-4aa4-975a-1e9fc381c41c" released by "delete_volume" :: held 0.719s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Created reservations ['5b6da4f2-ce95-41dc-9a39-1e6313ba1628', 'bc944a8e-b658-4c87-bc1d-85130f5bdc90', 'c1fe7d78-e65e-435b-b64e-cc6ba85acd02', '4b3f3504-26f4-4449-9f9e-8e41ad80b2c5'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:01 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:01 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:01 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 1073741824" returned: 0 in 0.540s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:01 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 Sep 15 18:53:01 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:01 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.328s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:01 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Deleted volume successfully. Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1826bf96-07e5-4f23-985d-ee37c35542c4 tempest-VolumesActionsTest-48180588 None] Lock "cinder-678349de-f4be-4aa4-975a-1e9fc381c41c-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:01 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:01 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=150,cinder:SELECT=128,cinder:INSERT=37,cinder:DELETE=8 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Attempting download of cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume 2e2fe520-f07d-4109-b096-813320ca8198. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cada179e-cca2-40f5-9a97-8b4dd6a3b0f3]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_muzzde_z {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:02 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_muzzde_z Sep 15 18:53:02 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (8405c4c7-0d5e-4307-b765-aaceed47e78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5abcfc-0581-45a3-805b-9c9dd07b2011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5abcfc-0581-45a3-805b-9c9dd07b2011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-189960338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9a0c6a-cd35-4913-bea9-a8b5d808203a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:02Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8deeefed-b46a-48d4-99aa-7fb672887283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8deeefed-b46a-48d4-99aa-7fb672887283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad79c0d1-ee00-41c5-86b2-563bf66390f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad79c0d1-ee00-41c5-86b2-563bf66390f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9a0c6a-cd35-4913-bea9-a8b5d808203a', 'volume_name': 'volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c29731d-53c9-433a-afb6-33019faa8731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:02 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c29731d-53c9-433a-afb6-33019faa8731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94c5747-06b1-40e3-a0d0-cf60d188a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:02 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Volume 1d9a0c6a-cd35-4913-bea9-a8b5d808203a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a', 'volume_size': 1} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-189960338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9a0c6a-cd35-4913-bea9-a8b5d808203a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:02Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Creating volume 1d9a0c6a-cd35-4913-bea9-a8b5d808203a {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:02 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_muzzde_z" returned: 0 in 0.402s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_muzzde_z {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:02 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a 1073741824 Sep 15 18:53:02 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:02 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_muzzde_z Sep 15 18:53:02 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:02 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_muzzde_z" returned: 1 in 0.392s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_muzzde_z' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[db08a592-baae-4bec-af3b-999cbd769560]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:02 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a 1073741824" returned: 0 in 0.482s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:03 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD Sep 15 18:53:03 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:03 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a Sep 15 18:53:03 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:03 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:03 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a" returned: 0 in 0.275s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] cb9e9155-abe1-4ceb-8a92-39c0a579534a was qcow2, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94c5747-06b1-40e3-a0d0-cf60d188a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c595756-d8d5-4847-ba14-3bb18c364ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:03 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 Sep 15 18:53:03 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Volume volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a (1d9a0c6a-cd35-4913-bea9-a8b5d808203a): created successfully Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c595756-d8d5-4847-ba14-3bb18c364ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (8405c4c7-0d5e-4307-b765-aaceed47e78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:03 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b0e8c0bb-ebe8-4f2a-bc21-18c954aadede tempest-VolumesActionsTest-1759082154 None] Created volume successfully. Sep 15 18:53:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Acquiring lock "cinder-1d9a0c6a-cd35-4913-bea9-a8b5d808203a-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Lock "cinder-1d9a0c6a-cd35-4913-bea9-a8b5d808203a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Acquiring lock "cinder-quobyte-1d9a0c6a-cd35-4913-bea9-a8b5d808203a" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Lock "cinder-quobyte-1d9a0c6a-cd35-4913-bea9-a8b5d808203a" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:04 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb01098-9f54-4161-aeb9-010c7331d5d1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:04 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a Sep 15 18:53:04 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:05 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a" returned: 0 in 0.435s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:05 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a Sep 15 18:53:05 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:05 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d9a0c6a-cd35-4913-bea9-a8b5d808203a" returned: 0 in 0.333s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Lock "cinder-quobyte-1d9a0c6a-cd35-4913-bea9-a8b5d808203a" released by "delete_volume" :: held 0.828s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:05 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198" returned: 0 in 2.285s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_b_n29h4tdevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:53:05 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Converted 112.00 MB image at 48.95 MB/s Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:05 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 1G Sep 15 18:53:05 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Created reservations ['54e002f1-e693-4420-a807-88a7d5fd2e98', '5b61942e-6415-404f-86ec-b322dfc62c5b', '612d0d82-46d3-49ad-9d1d-fc9ff3ba4d82', 'd54d6f67-c590-43b5-a76d-b02b1e4eff21'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:05 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:05 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:06 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 1G" returned: 0 in 0.429s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Downloaded image cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume 2e2fe520-f07d-4109-b096-813320ca8198 successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a for user b9408c5e58e14eb4bb57e81e1d06192c is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Marking volume 2e2fe520-f07d-4109-b096-813320ca8198 as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Copying metadata from image cb9e9155-abe1-4ceb-8a92-39c0a579534a to 2e2fe520-f07d-4109-b096-813320ca8198. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Creating volume glance metadata for volume 2e2fe520-f07d-4109-b096-813320ca8198 backed by image cb9e9155-abe1-4ceb-8a92-39c0a579534a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 18:53:06 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.388s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Deleted volume successfully. Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-68535628-db9b-4210-a12a-daf4ef09abd3 tempest-VolumesActionsTest-48180588 None] Lock "cinder-1d9a0c6a-cd35-4913-bea9-a8b5d808203a-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de7d4f4-0d96-46d7-8772-c4bb629a77bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e2fe520-f07d-4109-b096-813320ca8198', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ca7ff2-53f2-48df-a7f9-ceb3f50aa397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:06 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Volume volume-2e2fe520-f07d-4109-b096-813320ca8198 (2e2fe520-f07d-4109-b096-813320ca8198): created successfully Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ca7ff2-53f2-48df-a7f9-ceb3f50aa397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (4cf6b1c8-ebbd-4145-b0e1-c445840c336a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9d5ed3c4-5af5-42a0-9ef1-bbca54d8886e tempest-VolumesGetTest-1492035707 None] Created volume successfully. Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (edd7f3bf-7287-483f-96b1-b68f7820108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e0c3b0-6702-4773-953f-f9949daee3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e0c3b0-6702-4773-953f-f9949daee3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1213372322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:06Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d967f0ee-7c0a-4b4e-8e73-0eb28297271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d967f0ee-7c0a-4b4e-8e73-0eb28297271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25950ae-15ef-40bd-ad1c-2a6a4e92abb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25950ae-15ef-40bd-ad1c-2a6a4e92abb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1', 'volume_name': 'volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab981a75-27e5-4814-85a8-44ffdebcb08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab981a75-27e5-4814-85a8-44ffdebcb08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe5caf8-d4da-4280-a2f6-56c1b60ec2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:06 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Volume 306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1', 'volume_size': 1} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1213372322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:06Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Creating volume 306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:06 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:06 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 1073741824 Sep 15 18:53:06 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:07 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 1073741824" returned: 0 in 0.501s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:07 devstack sudo[96493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 Sep 15 18:53:07 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:07 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (1972a196-5858-4964-a3ab-986e54dd2803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4a1f02-e32b-4def-bb15-2cd7b5aa43ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1" returned: 0 in 0.437s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4a1f02-e32b-4def-bb15-2cd7b5aa43ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1515375498',display_name='tempest-VolumesGetTest-Volume-893794826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bbf7b0-afbd-4c72-92e0-91906a262093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:08Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcf1517-db6e-497f-b687-ead365258e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fcf1517-db6e-497f-b687-ead365258e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538b5a8d-c80f-4a70-9347-61273cd44eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (538b5a8d-c80f-4a70-9347-61273cd44eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32bbf7b0-afbd-4c72-92e0-91906a262093', 'volume_name': 'volume-32bbf7b0-afbd-4c72-92e0-91906a262093', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5e6b85-222a-463e-85f8-3fa19c7991e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5e6b85-222a-463e-85f8-3fa19c7991e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e10c054-578a-4338-8362-c7ef2e631fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Volume 32bbf7b0-afbd-4c72-92e0-91906a262093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32bbf7b0-afbd-4c72-92e0-91906a262093', 'volume_size': 1} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1515375498',display_name='tempest-VolumesGetTest-Volume-893794826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bbf7b0-afbd-4c72-92e0-91906a262093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917804957a304601ae039852063d9d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:08Z,use_quota=True,user_id='b9408c5e58e14eb4bb57e81e1d06192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Creating volume 32bbf7b0-afbd-4c72-92e0-91906a262093 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:07 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe5caf8-d4da-4280-a2f6-56c1b60ec2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f76a17-86e1-4335-bfc6-6b28435acaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:07 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093 1073741824 Sep 15 18:53:07 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Volume volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 (306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1): created successfully Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f76a17-86e1-4335-bfc6-6b28435acaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (edd7f3bf-7287-483f-96b1-b68f7820108b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9cf5ed99-b631-4d5c-aa71-aeb819ca02f6 tempest-VolumesActionsTest-1759082154 None] Created volume successfully. Sep 15 18:53:08 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093 1073741824" returned: 0 in 0.463s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:08 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093 Sep 15 18:53:08 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:08 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093" returned: 0 in 0.301s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e10c054-578a-4338-8362-c7ef2e631fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bbf7b0-afbd-4c72-92e0-91906a262093', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded6e53b-65eb-409d-bd00-234a612332ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:08 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Volume volume-32bbf7b0-afbd-4c72-92e0-91906a262093 (32bbf7b0-afbd-4c72-92e0-91906a262093): created successfully Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded6e53b-65eb-409d-bd00-234a612332ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Flow 'volume_create_manager' (1972a196-5858-4964-a3ab-986e54dd2803) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bef2afe3-2832-40d1-8faf-ea7cc4aea15d tempest-VolumesGetTest-1492035707 None] Created volume successfully. Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Acquiring lock "cinder-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Lock "cinder-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Acquiring lock "cinder-quobyte-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Lock "cinder-quobyte-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6247414c-4c90-4673-8dd8-aff5315109b9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:09 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 Sep 15 18:53:09 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:09 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1" returned: 0 in 0.418s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:09 devstack sudo[96510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1 Sep 15 18:53:09 devstack sudo[96510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:09 devstack sudo[96510]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1" returned: 0 in 0.336s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Lock "cinder-quobyte-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1" released by "delete_volume" :: held 0.835s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Created reservations ['16d1b3de-5c6e-4d08-ba28-b431d009a2a1', 'b8b820ff-7cbe-4280-a48c-cf8f01b9011e', '25910de7-2beb-4948-b31c-a855ddf14c6b', '5f1a5b61-d58e-441d-9fea-888569730ce1'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-32bbf7b0-afbd-4c72-92e0-91906a262093-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Lock "cinder-32bbf7b0-afbd-4c72-92e0-91906a262093-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:10 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:10 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-quobyte-32bbf7b0-afbd-4c72-92e0-91906a262093" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-32bbf7b0-afbd-4c72-92e0-91906a262093" acquired by "delete_volume" :: waited 0.063s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8319d290-19b7-4ca5-8497-bb3473c56ce6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:10 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.667s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:10 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093 Sep 15 18:53:10 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:10 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Deleted volume successfully. Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7e0e39fc-4b6b-466a-954c-f41980829ac1 tempest-VolumesActionsTest-48180588 None] Lock "cinder-306ebb8e-41df-4a0c-b9f8-b79fa5c5a4f1-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Flow 'volume_create_manager' (c55bc24d-5470-4831-b46c-b9321152f8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476a1882-9993-447a-90c8-1f5e0831c579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476a1882-9993-447a-90c8-1f5e0831c579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1771781942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2726ca-1321-4474-9cb9-39b5444e007c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927977e5d9904441855219a128b033f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:11Z,use_quota=True,user_id='8949a22e45784d3b8fb57bf337e75280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394d3edb-8d58-4295-ab46-a24e4c68d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394d3edb-8d58-4295-ab46-a24e4c68d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea11053b-2f11-4e33-8620-4e531d162055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea11053b-2f11-4e33-8620-4e531d162055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2726ca-1321-4474-9cb9-39b5444e007c', 'volume_name': 'volume-6c2726ca-1321-4474-9cb9-39b5444e007c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93cd8139-54e5-4a7f-894a-06e142795e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93cd8139-54e5-4a7f-894a-06e142795e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bc94a8-c452-41d0-b2e3-7782e9b48042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:10 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Volume 6c2726ca-1321-4474-9cb9-39b5444e007c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2726ca-1321-4474-9cb9-39b5444e007c', 'volume_size': 1} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1771781942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2726ca-1321-4474-9cb9-39b5444e007c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927977e5d9904441855219a128b033f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:11Z,use_quota=True,user_id='8949a22e45784d3b8fb57bf337e75280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Creating volume 6c2726ca-1321-4474-9cb9-39b5444e007c {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:10 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:10 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c 1073741824 Sep 15 18:53:10 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:11 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093" returned: 0 in 0.739s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:11 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093 Sep 15 18:53:11 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (894eae9f-a06d-404e-abea-9c33b747ce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34a440d-e681-46a5-813b-13e8c9838248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34a440d-e681-46a5-813b-13e8c9838248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463834392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600f4d90-0182-4cb7-a002-b775b9b3a7f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:11Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f2ec9f-07dc-4424-8ea2-ce3adf16b3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f2ec9f-07dc-4424-8ea2-ce3adf16b3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174d1bb0-0f87-4579-a845-4637c349d109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (174d1bb0-0f87-4579-a845-4637c349d109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600f4d90-0182-4cb7-a002-b775b9b3a7f6', 'volume_name': 'volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc5fc11-327a-4685-ae9f-447aeaa1dcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddc5fc11-327a-4685-ae9f-447aeaa1dcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9707bf-3304-4d16-a6cf-ebc8f4858e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:11 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Volume 600f4d90-0182-4cb7-a002-b775b9b3a7f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6', 'volume_size': 1} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:11 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32bbf7b0-afbd-4c72-92e0-91906a262093" returned: 0 in 0.334s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-32bbf7b0-afbd-4c72-92e0-91906a262093" released by "delete_volume" :: held 1.200s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Created reservations ['6bdfd58a-56f0-4ca0-a7ea-998b866779d2', '100e1c18-88d9-49d4-87cc-4c014121f147', 'c7b302aa-311e-4954-9988-dee195dc1b60', 'c9238e2f-c5f0-4dc2-bcd3-a81aa03a4957'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:11 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c 1073741824" returned: 0 in 0.602s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:11 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:11 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:11 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c Sep 15 18:53:11 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:11 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.334s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Deleted volume successfully. Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a68c255-cda2-4ef2-965b-25229285119b tempest-VolumesGetTest-1492035707 None] Lock "cinder-32bbf7b0-afbd-4c72-92e0-91906a262093-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:11 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c" returned: 0 in 0.307s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.678s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463834392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600f4d90-0182-4cb7-a002-b775b9b3a7f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:11Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Creating volume 600f4d90-0182-4cb7-a002-b775b9b3a7f6 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:11 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bc94a8-c452-41d0-b2e3-7782e9b48042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2726ca-1321-4474-9cb9-39b5444e007c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:11 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 1073741824 Sep 15 18:53:11 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b66a6a-eff1-4b80-9dc8-ebfbad1d72c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:12 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Volume volume-6c2726ca-1321-4474-9cb9-39b5444e007c (6c2726ca-1321-4474-9cb9-39b5444e007c): created successfully Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1b66a6a-eff1-4b80-9dc8-ebfbad1d72c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Flow 'volume_create_manager' (c55bc24d-5470-4831-b46c-b9321152f8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:12 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7eb245bd-ee01-4f80-a8e7-c7a897e85422 tempest-AttachVolumeNegativeTest-522311683 None] Created volume successfully. Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-2e2fe520-f07d-4109-b096-813320ca8198-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Lock "cinder-2e2fe520-f07d-4109-b096-813320ca8198-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Acquiring lock "cinder-quobyte-2e2fe520-f07d-4109-b096-813320ca8198" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-2e2fe520-f07d-4109-b096-813320ca8198" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3373fff-ed28-4951-9103-489d9c0924eb]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:12 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 1073741824" returned: 0 in 0.622s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:12 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 Sep 15 18:53:12 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:12 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 Sep 15 18:53:12 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:13 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6" returned: 0 in 0.397s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9707bf-3304-4d16-a6cf-ebc8f4858e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e4de3-863f-4d1a-a9ba-64e658cf55d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:13 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:13 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Volume volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 (600f4d90-0182-4cb7-a002-b775b9b3a7f6): created successfully Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e4de3-863f-4d1a-a9ba-64e658cf55d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (894eae9f-a06d-404e-abea-9c33b747ce49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198" returned: 0 in 0.564s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:13 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-13ce5137-b46d-4991-b8ff-d6b3d13c938c tempest-VolumesActionsTest-1759082154 None] Created volume successfully. Sep 15 18:53:13 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198 Sep 15 18:53:13 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:13 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2e2fe520-f07d-4109-b096-813320ca8198" returned: 0 in 0.341s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Lock "cinder-quobyte-2e2fe520-f07d-4109-b096-813320ca8198" released by "delete_volume" :: held 0.988s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Created reservations ['48198c1a-4f5c-43e6-baff-1dc8e153ab1d', 'aea3d8f9-6f5a-4d0e-8876-9f60d94a9830', '2f52d57f-21cd-4658-a3f6-275b865a9b2d', 'ab84da60-6f2e-4638-ba37-1c9ea97bc689'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Acquiring lock "cinder-600f4d90-0182-4cb7-a002-b775b9b3a7f6-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Lock "cinder-600f4d90-0182-4cb7-a002-b775b9b3a7f6-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:13 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:13 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Acquiring lock "cinder-quobyte-600f4d90-0182-4cb7-a002-b775b9b3a7f6" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Lock "cinder-quobyte-600f4d90-0182-4cb7-a002-b775b9b3a7f6" acquired by "delete_volume" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5917ea10-2f86-4053-b1a0-823ab9ba8a33]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:14 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 Sep 15 18:53:14 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:14 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.450s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Deleted volume successfully. Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52f386d1-f970-4e92-a788-e375bfe881ea tempest-VolumesGetTest-1492035707 None] Lock "cinder-2e2fe520-f07d-4109-b096-813320ca8198-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-bfa5dc2f-8b81-41ed-84d8-2de88411e695 req-d3c006f3-2ce2-4511-907f-b8ad826c0332 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-bfa5dc2f-8b81-41ed-84d8-2de88411e695 req-d3c006f3-2ce2-4511-907f-b8ad826c0332 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-bfa5dc2f-8b81-41ed-84d8-2de88411e695 req-d3c006f3-2ce2-4511-907f-b8ad826c0332 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:14 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6" returned: 0 in 0.577s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-bfa5dc2f-8b81-41ed-84d8-2de88411e695 req-d3c006f3-2ce2-4511-907f-b8ad826c0332 tempest-AttachVolumeNegativeTest-522311683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-6c2726ca-1321-4474-9cb9-39b5444e007c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6f39b78-3477-4ed4-8ce0-a209e8fb6cd5', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:53:14 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6 Sep 15 18:53:14 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-bfa5dc2f-8b81-41ed-84d8-2de88411e695 req-d3c006f3-2ce2-4511-907f-b8ad826c0332 tempest-AttachVolumeNegativeTest-522311683 None] attachment_update completed successfully. Sep 15 18:53:14 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-600f4d90-0182-4cb7-a002-b775b9b3a7f6" returned: 0 in 0.386s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Lock "cinder-quobyte-600f4d90-0182-4cb7-a002-b775b9b3a7f6" released by "delete_volume" :: held 1.059s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Created reservations ['43dca6b6-e48a-4439-adfa-08a175e65015', '20815acb-1d27-4c17-b772-3502f6d656aa', 'f945a057-7685-41eb-bfac-d06bae16e85e', '1c9bf715-b282-4a1f-a3e5-acd6032d138e'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:15 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:15 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:15 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.364s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Deleted volume successfully. Sep 15 18:53:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6c2d58b-e8d7-45de-b669-1d27a3ecd0ab tempest-VolumesActionsTest-48180588 None] Lock "cinder-600f4d90-0182-4cb7-a002-b775b9b3a7f6-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (0a27e5f8-a700-4b69-a010-b661f566fec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948cf270-a1fe-4394-af79-3f80c1932ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948cf270-a1fe-4394-af79-3f80c1932ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1344604246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e52470-54df-4bad-83d5-82f5db59e4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:17Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598d41ac-2fe1-497c-b517-7f3da97ab62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (598d41ac-2fe1-497c-b517-7f3da97ab62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cfd1b8-9a6f-4034-9ce8-3923d69eb2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cfd1b8-9a6f-4034-9ce8-3923d69eb2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35e52470-54df-4bad-83d5-82f5db59e4f6', 'volume_name': 'volume-35e52470-54df-4bad-83d5-82f5db59e4f6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd3fd87-4b2c-4a5a-8a18-bc5688fa16af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd3fd87-4b2c-4a5a-8a18-bc5688fa16af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1c9750-bc94-42d3-8510-dfa46f8fed2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:16 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Volume 35e52470-54df-4bad-83d5-82f5db59e4f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35e52470-54df-4bad-83d5-82f5db59e4f6', 'volume_size': 1} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1344604246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35e52470-54df-4bad-83d5-82f5db59e4f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896e1383536f4750b8be3805f1376635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:17Z,use_quota=True,user_id='f415a135025d4520b127e989501a99ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Creating volume 35e52470-54df-4bad-83d5-82f5db59e4f6 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:16 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:16 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6 1073741824 Sep 15 18:53:16 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:17 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-922f0260-caef-4710-be18-76044da8590d req-256c8bd6-ef64-4280-b85e-0fa79a1a39a4 tempest-AttachVolumeNegativeTest-522311683 None] Terminate volume connection completed successfully. Sep 15 18:53:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-922f0260-caef-4710-be18-76044da8590d req-256c8bd6-ef64-4280-b85e-0fa79a1a39a4 tempest-AttachVolumeNegativeTest-522311683 None] Deleting attachment d6f39b78-3477-4ed4-8ce0-a209e8fb6cd5. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:53:17 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6 1073741824" returned: 0 in 0.751s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:17 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6 Sep 15 18:53:17 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:17 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6" returned: 0 in 0.320s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc1c9750-bc94-42d3-8510-dfa46f8fed2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35e52470-54df-4bad-83d5-82f5db59e4f6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e294a601-3120-4409-b0a3-19cb8a7d5e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:18 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Volume volume-35e52470-54df-4bad-83d5-82f5db59e4f6 (35e52470-54df-4bad-83d5-82f5db59e4f6): created successfully Sep 15 18:53:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e294a601-3120-4409-b0a3-19cb8a7d5e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Flow 'volume_create_manager' (0a27e5f8-a700-4b69-a010-b661f566fec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:18 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f17d4c7a-fd0f-4c10-8375-af8d0d78ddd6 tempest-VolumesActionsTest-1759082154 None] Created volume successfully. Sep 15 18:53:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Acquiring lock "cinder-35e52470-54df-4bad-83d5-82f5db59e4f6-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Lock "cinder-35e52470-54df-4bad-83d5-82f5db59e4f6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Acquiring lock "cinder-quobyte-35e52470-54df-4bad-83d5-82f5db59e4f6" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Lock "cinder-quobyte-35e52470-54df-4bad-83d5-82f5db59e4f6" acquired by "delete_volume" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:20 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd1fa33-2cd5-4fe4-9ace-257b1d823386]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:20 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6 Sep 15 18:53:20 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:20 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6" returned: 0 in 0.724s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:20 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6 Sep 15 18:53:20 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:21 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-35e52470-54df-4bad-83d5-82f5db59e4f6" returned: 0 in 0.383s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Lock "cinder-quobyte-35e52470-54df-4bad-83d5-82f5db59e4f6" released by "delete_volume" :: held 1.197s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Created reservations ['67ad6df6-b4ba-43c2-9cac-2143d44f7636', '53ef045f-6150-4120-8687-f0108b8d3f90', 'ff5ba7ab-2c0d-432e-9a5f-cb54d89c26d9', '395bd70f-3a92-4a32-95c2-4b6c3d72a77f'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Flow 'volume_create_manager' (08356a5e-87c1-40e7-a239-019fceeaffc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10288bf2-84b8-45b0-8a5a-16c14483e3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10288bf2-84b8-45b0-8a5a-16c14483e3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1782444974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14f619e-36d3-42c3-b54c-b06fef1eafe3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60f0e2d2407040ada0164ef3c7a37302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:21Z,use_quota=True,user_id='cf1464d98e4b43649c24c8781c4eb705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43b75a6-2c95-4b6b-8284-17747b159c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a43b75a6-2c95-4b6b-8284-17747b159c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d12273b-67aa-46d4-8831-9cb058f1ae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d12273b-67aa-46d4-8831-9cb058f1ae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14f619e-36d3-42c3-b54c-b06fef1eafe3', 'volume_name': 'volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32aa3ce-df9e-4dd5-b35d-bf5eae4fab9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f32aa3ce-df9e-4dd5-b35d-bf5eae4fab9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebefae43-0fa9-4a0f-ac20-7a01a3620afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:21 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Volume c14f619e-36d3-42c3-b54c-b06fef1eafe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3', 'volume_size': 1} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1782444974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14f619e-36d3-42c3-b54c-b06fef1eafe3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60f0e2d2407040ada0164ef3c7a37302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:21Z,use_quota=True,user_id='cf1464d98e4b43649c24c8781c4eb705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Creating volume c14f619e-36d3-42c3-b54c-b06fef1eafe3 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:21 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:21 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 1073741824 Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:21 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:21 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:21 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:21 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.347s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:21 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Deleted volume successfully. Sep 15 18:53:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1ad1fd48-af51-492f-9ebb-e36ceb85757a tempest-VolumesActionsTest-1759082154 None] Lock "cinder-35e52470-54df-4bad-83d5-82f5db59e4f6-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:22 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 1073741824" returned: 0 in 0.560s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:22 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 Sep 15 18:53:22 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:22 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3" returned: 0 in 0.345s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebefae43-0fa9-4a0f-ac20-7a01a3620afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c16025a-d97a-450e-8f64-5364d53ad95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:22 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Volume volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 (c14f619e-36d3-42c3-b54c-b06fef1eafe3): created successfully Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c16025a-d97a-450e-8f64-5364d53ad95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Flow 'volume_create_manager' (08356a5e-87c1-40e7-a239-019fceeaffc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:22 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-acab7631-b292-4d6c-a402-754e129369cc tempest-VolumesListTestJSON-1908848190 None] Created volume successfully. Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "cinder-6c2726ca-1321-4474-9cb9-39b5444e007c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-6c2726ca-1321-4474-9cb9-39b5444e007c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "cinder-quobyte-6c2726ca-1321-4474-9cb9-39b5444e007c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-quobyte-6c2726ca-1321-4474-9cb9-39b5444e007c" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cffd68b-473d-4502-b923-5641d2e72fd9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:22 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c Sep 15 18:53:22 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:23 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c" returned: 0 in 0.400s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:23 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c Sep 15 18:53:23 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:23 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6c2726ca-1321-4474-9cb9-39b5444e007c" returned: 0 in 0.321s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-quobyte-6c2726ca-1321-4474-9cb9-39b5444e007c" released by "delete_volume" :: held 0.775s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Created reservations ['5020e9d5-a3c6-4cfd-9a6f-7a8cdc9fa89e', '319827af-1a5e-4a94-b4fe-635270064891', '8859ead3-f107-4220-ba33-d4feabd2bbee', 'e37a93a3-42aa-42e5-9c0c-8740eff5530c'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:23 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:23 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "cinder-56077a1f-2647-43ee-867d-78c501ac67fe-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-56077a1f-2647-43ee-867d-78c501ac67fe-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:24 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.480s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:24 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Deleted volume successfully. Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Flow 'volume_create_manager' (1254ea5c-72cf-4f76-883a-910346f12797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bae4c28-6612-463d-9c1b-34f6923845d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e3979bf6-95ee-4404-b9d1-ca4a48c83fc5 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-6c2726ca-1321-4474-9cb9-39b5444e007c-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "cinder-quobyte-56077a1f-2647-43ee-867d-78c501ac67fe" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bae4c28-6612-463d-9c1b-34f6923845d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1636879953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60f0e2d2407040ada0164ef3c7a37302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:24Z,use_quota=True,user_id='cf1464d98e4b43649c24c8781c4eb705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6662dfe3-bd96-44cc-b9a8-425a91584dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6662dfe3-bd96-44cc-b9a8-425a91584dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006a5fb5-9141-4e88-b88c-e1509e6ec176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006a5fb5-9141-4e88-b88c-e1509e6ec176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9', 'volume_name': 'volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b980fb1-a0b1-4d10-80bf-92a3e49f2bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b980fb1-a0b1-4d10-80bf-92a3e49f2bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb04ae0-548c-423a-9d69-b433e8c22898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:24 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Volume 2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9', 'volume_size': 1} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1636879953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60f0e2d2407040ada0164ef3c7a37302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:24Z,use_quota=True,user_id='cf1464d98e4b43649c24c8781c4eb705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Creating volume 2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:24 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-quobyte-56077a1f-2647-43ee-867d-78c501ac67fe" acquired by "delete_volume" :: waited 0.107s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:24 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 1073741824 Sep 15 18:53:24 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d6b039-84ee-4728-b4f4-44596c36852f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:24 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe Sep 15 18:53:24 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:25 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe" returned: 0 in 0.510s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:25 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe Sep 15 18:53:25 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:25 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 1073741824" returned: 0 in 0.674s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:25 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 Sep 15 18:53:25 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:25 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-56077a1f-2647-43ee-867d-78c501ac67fe" returned: 0 in 0.349s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-quobyte-56077a1f-2647-43ee-867d-78c501ac67fe" released by "delete_volume" :: held 0.917s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Created reservations ['1c4ef682-ce38-4be5-8597-2a0d8b3ac49a', '88c909ab-29e2-444d-9d38-3335f53ec04e', '6778323c-17a9-41a8-a7a6-4699ca9213e5', '4decf293-8769-49fd-9e78-adf8ce73110c'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:25 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9" returned: 0 in 0.420s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:25 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:25 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb04ae0-548c-423a-9d69-b433e8c22898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87a0ddc-8675-4027-b676-488829cc5fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:25 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Volume volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 (2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9): created successfully Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b87a0ddc-8675-4027-b676-488829cc5fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Flow 'volume_create_manager' (1254ea5c-72cf-4f76-883a-910346f12797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d5669a44-1293-480f-a661-4aa420fc7358 tempest-VolumesListTestJSON-1908848190 None] Created volume successfully. Sep 15 18:53:25 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.295s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Deleted volume successfully. Sep 15 18:53:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9febb583-989e-458b-9cde-4c338e1d2400 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-56077a1f-2647-43ee-867d-78c501ac67fe-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "cinder-ea1a9a17-7933-48ce-ae73-4fc8c0137092-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-ea1a9a17-7933-48ce-ae73-4fc8c0137092-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "cinder-quobyte-ea1a9a17-7933-48ce-ae73-4fc8c0137092" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-quobyte-ea1a9a17-7933-48ce-ae73-4fc8c0137092" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cef39b7-44ac-4d77-82c2-e7b8e3a8ae19]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:27 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 Sep 15 18:53:27 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Flow 'volume_create_manager' (ef22eac1-86c4-40ce-9e6f-ff3f7bc83689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a681caa7-9ffd-43a7-a9fd-eaf3329dc67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a681caa7-9ffd-43a7-a9fd-eaf3329dc67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-11213889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60f0e2d2407040ada0164ef3c7a37302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:27Z,use_quota=True,user_id='cf1464d98e4b43649c24c8781c4eb705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a048b473-524b-4f80-92f6-d2eb163726d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a048b473-524b-4f80-92f6-d2eb163726d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbfc43d-4964-493a-826b-daee279ab618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bbfc43d-4964-493a-826b-daee279ab618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3', 'volume_name': 'volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c17356-a49a-475c-92d0-1f921368bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c17356-a49a-475c-92d0-1f921368bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945d8719-dad5-4abc-88de-f48642e79b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:27 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Volume a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3', 'volume_size': 1} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-11213889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='60f0e2d2407040ada0164ef3c7a37302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:27Z,use_quota=True,user_id='cf1464d98e4b43649c24c8781c4eb705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Creating volume a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:27 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:27 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 1073741824 Sep 15 18:53:27 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:27 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092" returned: 0 in 0.487s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:27 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092 Sep 15 18:53:27 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:27 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ea1a9a17-7933-48ce-ae73-4fc8c0137092" returned: 0 in 0.364s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-quobyte-ea1a9a17-7933-48ce-ae73-4fc8c0137092" released by "delete_volume" :: held 0.918s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Created reservations ['bf51da76-7502-44a0-92a9-1d53f1936909', '3024bd8a-f7df-4c03-ba3c-7b7b7522a92c', '5e2f2d4f-700b-48e7-8591-a4894a728863', 'aeb6a1b4-2580-4494-ab3d-f684d8ad6a55'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:28 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:28 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:28 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 1073741824" returned: 0 in 0.859s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:28 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 Sep 15 18:53:28 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:28 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Deleted volume successfully. Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d9c2302-e32d-419e-93b2-3394f66119e4 tempest-AttachVolumeNegativeTest-522311683 None] Lock "cinder-ea1a9a17-7933-48ce-ae73-4fc8c0137092-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:28 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3" returned: 0 in 0.363s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945d8719-dad5-4abc-88de-f48642e79b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db462ae3-7da4-4581-b37e-ea8d11341129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:28 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Volume volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 (a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3): created successfully Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db462ae3-7da4-4581-b37e-ea8d11341129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Flow 'volume_create_manager' (ef22eac1-86c4-40ce-9e6f-ff3f7bc83689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1b721cf7-c860-4a19-aab7-4198e6797cfe tempest-VolumesListTestJSON-1908848190 None] Created volume successfully. Sep 15 18:53:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "cinder-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "cinder-quobyte-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-quobyte-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:31 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d97bb-6493-4cbb-8149-1bc8cfa228fb]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:32 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 Sep 15 18:53:32 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:32 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3" returned: 0 in 0.488s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:32 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3 Sep 15 18:53:32 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:32 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3" returned: 0 in 0.404s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-quobyte-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3" released by "delete_volume" :: held 0.969s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Created reservations ['df6e1c66-33fd-4f7c-bc4d-28415ffa8584', '0c63019b-e666-4259-ac30-27e8b2e8bdb7', 'bcdd8c38-96f0-43e4-93b6-21201e75ec8e', '5b9f0fe9-1757-4d11-b960-3281ae6de26a'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:33 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:33 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:33 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.321s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Deleted volume successfully. Sep 15 18:53:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9d76442a-3ea1-4b4b-bdcf-a0ad8218b5d3 tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-a07f1041-b8c2-48b5-a75c-4e83a6a0d4b3-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "cinder-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "cinder-quobyte-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-quobyte-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9" acquired by "delete_volume" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:34 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fbd636-f4b3-447c-b48e-e22fec67d5e6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:34 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 Sep 15 18:53:34 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:34 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9" returned: 0 in 0.488s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:34 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9 Sep 15 18:53:34 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:35 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9" returned: 0 in 0.306s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-quobyte-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9" released by "delete_volume" :: held 0.849s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Created reservations ['937e86f8-a419-4e9c-b92e-7f6cbcdd4e28', 'f6d28073-3ba6-41f0-aa8c-9227082aa2bf', 'cbc465f8-54d4-400b-a106-27f0700fe452', '54a2324a-af94-4310-b750-13b594f53c24'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:35 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:35 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "cinder-c14f619e-36d3-42c3-b54c-b06fef1eafe3-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-c14f619e-36d3-42c3-b54c-b06fef1eafe3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "cinder-quobyte-c14f619e-36d3-42c3-b54c-b06fef1eafe3" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:35 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.409s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:35 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Deleted volume successfully. Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-quobyte-c14f619e-36d3-42c3-b54c-b06fef1eafe3" acquired by "delete_volume" :: waited 0.042s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f419816-813c-4e56-a804-9735b286363f tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-2bc1e8b3-3791-4ca5-b780-fbdd42ad0da9-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9e3275-03e2-4af7-b49d-e28ccf6a09ff]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:35 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 Sep 15 18:53:35 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:36 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3" returned: 0 in 0.430s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:36 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3 Sep 15 18:53:36 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:36 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c14f619e-36d3-42c3-b54c-b06fef1eafe3" returned: 0 in 0.334s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-quobyte-c14f619e-36d3-42c3-b54c-b06fef1eafe3" released by "delete_volume" :: held 0.836s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Created reservations ['6d4b7c47-4be0-41d5-9af9-1914e7b1606e', 'f56f232e-6fdb-4580-8258-f5b3633c1386', 'e944f315-f05f-47cf-bd13-5a4abd4f12f3', '20298ee1-6184-4884-a5ed-5513a6cedd54'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:36 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:36 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:37 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.368s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:37 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Deleted volume successfully. Sep 15 18:53:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0e4b10b-5137-4fa0-b04e-4be655d77fe1 tempest-VolumesListTestJSON-1908848190 None] Lock "cinder-c14f619e-36d3-42c3-b54c-b06fef1eafe3-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Flow 'volume_create_manager' (3f66209b-96f0-4951-9e2f-cbdfe8fc923b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe5de3e-a52f-4640-9fed-5def9e1c035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe5de3e-a52f-4640-9fed-5def9e1c035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-232452133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047cb9b7-6c34-4c8e-acf0-461eb08c3b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a82ac6182b43f183be5bc55ed24713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:39Z,use_quota=True,user_id='61a8f566df2d4ee180836aa4e083a867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6581a866-7531-4ba3-b43f-631717d96256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6581a866-7531-4ba3-b43f-631717d96256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a098c62-06c4-4d1f-883c-3bcfa33f4276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a098c62-06c4-4d1f-883c-3bcfa33f4276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '047cb9b7-6c34-4c8e-acf0-461eb08c3b25', 'volume_name': 'volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c825dd2d-ecf1-4f58-a50b-6fed1904265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c825dd2d-ecf1-4f58-a50b-6fed1904265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1313b11-bb6e-4d7c-aa6c-587064c88303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:39 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Volume 047cb9b7-6c34-4c8e-acf0-461eb08c3b25: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 18:53:39 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Trying to clone 047cb9b7-6c34-4c8e-acf0-461eb08c3b25 from image cb9e9155-abe1-4ceb-8a92-39c0a579534a at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 18:53:40 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 18:53:40 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Image download 20.69 MB at 20.69 MB/s Sep 15 18:53:40 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8e1b94-61f4-461f-91b7-953aaabb48d6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:40 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD Sep 15 18:53:40 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:40 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:40 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a is fetched for user 61a8f566df2d4ee180836aa4e083a867. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 18:53:40 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0a28ec-2da2-446a-bda7-b667d265b3de]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:41 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD Sep 15 18:53:41 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:41 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-232452133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=047cb9b7-6c34-4c8e-acf0-461eb08c3b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a82ac6182b43f183be5bc55ed24713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:39Z,use_quota=True,user_id='61a8f566df2d4ee180836aa4e083a867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Creating volume 047cb9b7-6c34-4c8e-acf0-461eb08c3b25 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:41 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:41 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 1073741824 Sep 15 18:53:41 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:41 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 1073741824" returned: 0 in 0.534s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:41 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 Sep 15 18:53:41 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:42 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25" returned: 0 in 0.290s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:42 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Attempting download of cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume 047cb9b7-6c34-4c8e-acf0-461eb08c3b25. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 18:53:42 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1f20c3-3aae-46d5-9e40-c41b6ebe4318]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_d0v_w_xh {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:42 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_d0v_w_xh Sep 15 18:53:42 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:42 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_d0v_w_xh" returned: 0 in 0.515s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_d0v_w_xh {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:42 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_d0v_w_xh Sep 15 18:53:42 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Flow 'volume_create_manager' (bc5c39df-777a-4c49-b74d-6eb084cd3b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867c677d-56b5-45d7-b49a-57aee5d69065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867c677d-56b5-45d7-b49a-57aee5d69065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-736456381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc99cfd-371d-484e-beeb-bfb495bd2c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29401c0f46624536a492bd93ed57466b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:43Z,use_quota=True,user_id='b48dafd44d9149b69795f4d31113cda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b18bed-a989-4f21-a467-cade1ce61e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97b18bed-a989-4f21-a467-cade1ce61e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdc1c20-e05d-4de9-9eab-7ca550b89414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdc1c20-e05d-4de9-9eab-7ca550b89414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc99cfd-371d-484e-beeb-bfb495bd2c10', 'volume_name': 'volume-edc99cfd-371d-484e-beeb-bfb495bd2c10', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61ca430-578c-4a90-bcad-c32e16dcab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61ca430-578c-4a90-bcad-c32e16dcab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c619bb9-176f-4921-87a5-d4b47e14c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Volume edc99cfd-371d-484e-beeb-bfb495bd2c10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc99cfd-371d-484e-beeb-bfb495bd2c10', 'volume_size': 1} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-736456381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc99cfd-371d-484e-beeb-bfb495bd2c10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29401c0f46624536a492bd93ed57466b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:43Z,use_quota=True,user_id='b48dafd44d9149b69795f4d31113cda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Creating volume edc99cfd-371d-484e-beeb-bfb495bd2c10 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:43 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:43 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 1073741824 Sep 15 18:53:43 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Flow 'volume_create_manager' (158db8b8-7809-4852-bd8e-5caefc953a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da614bc3-a84f-45c9-baf5-2ff3c78c35ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da614bc3-a84f-45c9-baf5-2ff3c78c35ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-172131673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9434fbda434e4c169e6626e8526bd80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:43Z,use_quota=True,user_id='93e0927e77f3462c8745d8eecb1e6c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:43 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f73fa8-4bed-42e7-92cc-accd9701d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f73fa8-4bed-42e7-92cc-accd9701d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178e6652-e336-4f6e-89f1-87d660fb0656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178e6652-e336-4f6e-89f1-87d660fb0656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc', 'volume_name': 'volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a5c6a2-b673-4c91-a4d1-dc1d0ff75c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a5c6a2-b673-4c91-a4d1-dc1d0ff75c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8c5285-1826-4690-a01e-ee02a99f11fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:43 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Volume b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc', 'volume_size': 1} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_d0v_w_xh" returned: 1 in 0.444s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_d0v_w_xh' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39dc56c-4be8-4512-816f-85b6d6f58571]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:43 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD Sep 15 18:53:43 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:43 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] cb9e9155-abe1-4ceb-8a92-39c0a579534a was qcow2, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:43 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 1073741824" returned: 0 in 0.558s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:43 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 Sep 15 18:53:43 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:43 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 Sep 15 18:53:43 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:43 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Flow 'volume_create_manager' (f686bbad-7b31-4cbb-b399-fdda72739cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b45bcf5-f680-4c58-8352-0e971e68e694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b45bcf5-f680-4c58-8352-0e971e68e694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-814546714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8759a3-8489-4e50-8a4c-529d60040b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815feb3b9fc457bab87cfc8681175b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:44Z,use_quota=True,user_id='98b94e343d46490f89d2b4ce4e4e28f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfaf31b-883a-4d61-925e-89fe3fdc0037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfaf31b-883a-4d61-925e-89fe3fdc0037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261dac1e-bbe4-47e5-a0cd-969a3577fcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:44 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261dac1e-bbe4-47e5-a0cd-969a3577fcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8759a3-8489-4e50-8a4c-529d60040b06', 'volume_name': 'volume-6b8759a3-8489-4e50-8a4c-529d60040b06', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5cfcb71-c262-4d05-ae44-b7b247890000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5cfcb71-c262-4d05-ae44-b7b247890000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1842fb3-d727-4af9-9d60-2b55963d997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:44 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Volume 6b8759a3-8489-4e50-8a4c-529d60040b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8759a3-8489-4e50-8a4c-529d60040b06', 'volume_size': 1} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-172131673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9434fbda434e4c169e6626e8526bd80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:43Z,use_quota=True,user_id='93e0927e77f3462c8745d8eecb1e6c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Creating volume b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:44 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c619bb9-176f-4921-87a5-d4b47e14c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc99cfd-371d-484e-beeb-bfb495bd2c10', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:44 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc 1073741824 Sep 15 18:53:44 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aae0bb6-b60c-44ae-8d43-75ae5ab2a21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:44 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Volume volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 (edc99cfd-371d-484e-beeb-bfb495bd2c10): created successfully Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aae0bb6-b60c-44ae-8d43-75ae5ab2a21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Flow 'volume_create_manager' (bc5c39df-777a-4c49-b74d-6eb084cd3b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:44 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8daf3ac6-92c2-4747-b156-9c801af7f56b tempest-VolumesNegativeTest-297430659 None] Created volume successfully. Sep 15 18:53:44 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc 1073741824" returned: 0 in 0.548s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:44 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc Sep 15 18:53:44 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:44 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc" returned: 0 in 0.276s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-814546714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8759a3-8489-4e50-8a4c-529d60040b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815feb3b9fc457bab87cfc8681175b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:44Z,use_quota=True,user_id='98b94e343d46490f89d2b4ce4e4e28f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Creating volume 6b8759a3-8489-4e50-8a4c-529d60040b06 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:44 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8c5285-1826-4690-a01e-ee02a99f11fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:45 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06 1073741824 Sep 15 18:53:45 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497aae36-29f5-47eb-8657-9acfba2e1da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:45 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Volume volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc (b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc): created successfully Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497aae36-29f5-47eb-8657-9acfba2e1da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Flow 'volume_create_manager' (158db8b8-7809-4852-bd8e-5caefc953a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:45 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-be47659d-426b-4973-aff7-3b6ee54d5cb7 tempest-VolumesTestJSON-11834630 None] Created volume successfully. Sep 15 18:53:45 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06 1073741824" returned: 0 in 0.544s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:45 devstack sudo[97281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06 Sep 15 18:53:45 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:45 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25" returned: 0 in 2.116s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_5by56vjtdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:53:45 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Converted 112.00 MB image at 52.88 MB/s Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:45 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:45 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:45 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 1G Sep 15 18:53:45 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:45 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06" returned: 0 in 0.304s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1842fb3-d727-4af9-9d60-2b55963d997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8759a3-8489-4e50-8a4c-529d60040b06', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d0cb3e-96dc-4887-a34c-f9b843b743d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:45 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Volume volume-6b8759a3-8489-4e50-8a4c-529d60040b06 (6b8759a3-8489-4e50-8a4c-529d60040b06): created successfully Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d0cb3e-96dc-4887-a34c-f9b843b743d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Flow 'volume_create_manager' (f686bbad-7b31-4cbb-b399-fdda72739cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:45 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a0ef9780-8d2c-48d5-bd44-19154f3692c6 tempest-VolumesListAdminTestJSON-319839391 None] Created volume successfully. Sep 15 18:53:46 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.384s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:53:46 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 1G" returned: 0 in 0.498s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Downloaded image cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume 047cb9b7-6c34-4c8e-acf0-461eb08c3b25 successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a for user 61a8f566df2d4ee180836aa4e083a867 is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Marking volume 047cb9b7-6c34-4c8e-acf0-461eb08c3b25 as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Copying metadata from image cb9e9155-abe1-4ceb-8a92-39c0a579534a to 047cb9b7-6c34-4c8e-acf0-461eb08c3b25. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Creating volume glance metadata for volume 047cb9b7-6c34-4c8e-acf0-461eb08c3b25 backed by image cb9e9155-abe1-4ceb-8a92-39c0a579534a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1313b11-bb6e-4d7c-aa6c-587064c88303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9049ff25-c120-4a63-acbc-ed439ef5f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:46 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Volume volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 (047cb9b7-6c34-4c8e-acf0-461eb08c3b25): created successfully Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9049ff25-c120-4a63-acbc-ed439ef5f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Flow 'volume_create_manager' (3f66209b-96f0-4951-9e2f-cbdfe8fc923b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-76a7d0d9-f4b1-4c8c-a13b-2a66a253f03f tempest-TestShelveInstance-1320791387 None] Created volume successfully. Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Flow 'volume_create_manager' (b950c2ca-2286-4e6e-b859-e30d8641562e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af89b38-66ce-4c1e-a144-f5be3bb56300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af89b38-66ce-4c1e-a144-f5be3bb56300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-692416373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985a76cf-c416-45d6-b2a5-56e786ceb31f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9434fbda434e4c169e6626e8526bd80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:47Z,use_quota=True,user_id='93e0927e77f3462c8745d8eecb1e6c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33033d1c-a12b-42b8-b9b0-5b06c0a82970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33033d1c-a12b-42b8-b9b0-5b06c0a82970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795dba8e-edf7-45bb-b2e7-f4332e2161c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (795dba8e-edf7-45bb-b2e7-f4332e2161c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '985a76cf-c416-45d6-b2a5-56e786ceb31f', 'volume_name': 'volume-985a76cf-c416-45d6-b2a5-56e786ceb31f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02277ac-e84c-4374-8a9d-48affa2c5746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02277ac-e84c-4374-8a9d-48affa2c5746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d06786-9a38-4177-92a8-02ad0663820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:46 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Volume 985a76cf-c416-45d6-b2a5-56e786ceb31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-985a76cf-c416-45d6-b2a5-56e786ceb31f', 'volume_size': 1} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-692416373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985a76cf-c416-45d6-b2a5-56e786ceb31f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9434fbda434e4c169e6626e8526bd80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:47Z,use_quota=True,user_id='93e0927e77f3462c8745d8eecb1e6c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Creating volume 985a76cf-c416-45d6-b2a5-56e786ceb31f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:46 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:46 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f 1073741824 Sep 15 18:53:46 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:47 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f 1073741824" returned: 0 in 0.588s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:47 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f Sep 15 18:53:47 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:47 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f" returned: 0 in 0.408s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d06786-9a38-4177-92a8-02ad0663820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985a76cf-c416-45d6-b2a5-56e786ceb31f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5cfec1-c736-4228-a901-49e9a8d3a2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:48 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Volume volume-985a76cf-c416-45d6-b2a5-56e786ceb31f (985a76cf-c416-45d6-b2a5-56e786ceb31f): created successfully Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5cfec1-c736-4228-a901-49e9a8d3a2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Flow 'volume_create_manager' (b950c2ca-2286-4e6e-b859-e30d8641562e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Flow 'volume_create_manager' (31b0269e-5978-41b8-9324-056328cb7eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42f049c-3f54-4a5d-81f3-243166a14474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:48 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-60305010-edea-4900-9be6-b4d9ccf627de tempest-VolumesTestJSON-11834630 None] Created volume successfully. Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42f049c-3f54-4a5d-81f3-243166a14474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-316857077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ebc293-2131-40cf-9055-bb28349a84c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815feb3b9fc457bab87cfc8681175b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:48Z,use_quota=True,user_id='98b94e343d46490f89d2b4ce4e4e28f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc2b2c4-85a9-40e7-a94d-68e4a9b1a001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc2b2c4-85a9-40e7-a94d-68e4a9b1a001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658e9f2f-affe-4a97-8250-23ee85482043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (658e9f2f-affe-4a97-8250-23ee85482043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53ebc293-2131-40cf-9055-bb28349a84c6', 'volume_name': 'volume-53ebc293-2131-40cf-9055-bb28349a84c6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8727f2-7b75-415b-9ed9-baf39aeb92e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8727f2-7b75-415b-9ed9-baf39aeb92e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee0d912-9485-408b-a6d2-5c57ac0c5ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:48 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Volume 53ebc293-2131-40cf-9055-bb28349a84c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53ebc293-2131-40cf-9055-bb28349a84c6', 'volume_size': 1} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-316857077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ebc293-2131-40cf-9055-bb28349a84c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815feb3b9fc457bab87cfc8681175b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:48Z,use_quota=True,user_id='98b94e343d46490f89d2b4ce4e4e28f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Creating volume 53ebc293-2131-40cf-9055-bb28349a84c6 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:48 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:48 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6 1073741824 Sep 15 18:53:48 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:48 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6 1073741824" returned: 0 in 0.779s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:49 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6 Sep 15 18:53:49 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:49 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6" returned: 0 in 0.374s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee0d912-9485-408b-a6d2-5c57ac0c5ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ebc293-2131-40cf-9055-bb28349a84c6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca03b118-ea78-4f93-ae07-b60cc756e137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:49 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Volume volume-53ebc293-2131-40cf-9055-bb28349a84c6 (53ebc293-2131-40cf-9055-bb28349a84c6): created successfully Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca03b118-ea78-4f93-ae07-b60cc756e137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Flow 'volume_create_manager' (31b0269e-5978-41b8-9324-056328cb7eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:49 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b514a4c8-e35f-4e04-ab97-cc5df0d84761 tempest-VolumesListAdminTestJSON-319839391 None] Created volume successfully. Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Flow 'volume_create_manager' (03b9d94c-a7ac-4273-86b6-e5a0b4e0b73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3374a5-62fb-494e-aabb-673000bb79b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d3374a5-62fb-494e-aabb-673000bb79b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-216422950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dba0745-8998-4291-99b6-8da283e74944,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9434fbda434e4c169e6626e8526bd80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:50Z,use_quota=True,user_id='93e0927e77f3462c8745d8eecb1e6c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad1dd38-a7db-4e19-a199-a864c37b7375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad1dd38-a7db-4e19-a199-a864c37b7375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2181807-d168-4273-af1f-61dbf0613d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2181807-d168-4273-af1f-61dbf0613d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dba0745-8998-4291-99b6-8da283e74944', 'volume_name': 'volume-2dba0745-8998-4291-99b6-8da283e74944', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2db3105-f31b-41b8-8bd7-460bd6d36767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2db3105-f31b-41b8-8bd7-460bd6d36767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae60bab4-7b5c-4eae-a8c8-826fc51be219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:49 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Volume 2dba0745-8998-4291-99b6-8da283e74944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dba0745-8998-4291-99b6-8da283e74944', 'volume_size': 1} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-216422950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dba0745-8998-4291-99b6-8da283e74944,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9434fbda434e4c169e6626e8526bd80b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:50Z,use_quota=True,user_id='93e0927e77f3462c8745d8eecb1e6c3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Creating volume 2dba0745-8998-4291-99b6-8da283e74944 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:50 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:50 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944 1073741824 Sep 15 18:53:50 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:50 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944 1073741824" returned: 0 in 0.747s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:50 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944 Sep 15 18:53:50 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d9afd8dc-419a-4857-94ff-41c71d5e88bd req-eec339b4-525b-42e8-a28a-33eae66a2a42 tempest-TestShelveInstance-1320791387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:51 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Flow 'volume_create_manager' (71253dd6-bc46-4fac-bd7b-2f2e2d3a3135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd65cb62-a7cd-47e2-b651-61bf5d360eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944" returned: 0 in 0.373s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d9afd8dc-419a-4857-94ff-41c71d5e88bd req-eec339b4-525b-42e8-a28a-33eae66a2a42 tempest-TestShelveInstance-1320791387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.261s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd65cb62-a7cd-47e2-b651-61bf5d360eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-322372723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b45e890-8b9c-409a-a545-b38430029737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815feb3b9fc457bab87cfc8681175b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:51Z,use_quota=True,user_id='98b94e343d46490f89d2b4ce4e4e28f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9db8fb-e440-41e9-b16f-868f8c060e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9db8fb-e440-41e9-b16f-868f8c060e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e93a1b-d96f-43aa-b7f6-a05f3e24151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e93a1b-d96f-43aa-b7f6-a05f3e24151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b45e890-8b9c-409a-a545-b38430029737', 'volume_name': 'volume-4b45e890-8b9c-409a-a545-b38430029737', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171f1067-0a66-4280-832b-7317a95173b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171f1067-0a66-4280-832b-7317a95173b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e05414-f297-47a2-b37f-8417f0c17edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Volume 4b45e890-8b9c-409a-a545-b38430029737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b45e890-8b9c-409a-a545-b38430029737', 'volume_size': 1} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae60bab4-7b5c-4eae-a8c8-826fc51be219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dba0745-8998-4291-99b6-8da283e74944', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc5527e-916e-4300-88a5-609a95a69ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d9afd8dc-419a-4857-94ff-41c71d5e88bd req-eec339b4-525b-42e8-a28a-33eae66a2a42 tempest-TestShelveInstance-1320791387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.093s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-322372723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b45e890-8b9c-409a-a545-b38430029737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2815feb3b9fc457bab87cfc8681175b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:51Z,use_quota=True,user_id='98b94e343d46490f89d2b4ce4e4e28f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Creating volume 4b45e890-8b9c-409a-a545-b38430029737 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:51 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Volume volume-2dba0745-8998-4291-99b6-8da283e74944 (2dba0745-8998-4291-99b6-8da283e74944): created successfully Sep 15 18:53:51 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737 1073741824 Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc5527e-916e-4300-88a5-609a95a69ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:51 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Flow 'volume_create_manager' (03b9d94c-a7ac-4273-86b6-e5a0b4e0b73d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-80fdd83c-98ef-4097-a331-c2800c2a51bd tempest-VolumesTestJSON-11834630 None] Created volume successfully. Sep 15 18:53:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-d9afd8dc-419a-4857-94ff-41c71d5e88bd req-eec339b4-525b-42e8-a28a-33eae66a2a42 tempest-TestShelveInstance-1320791387 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1401a89c-ae7f-472a-ab8a-cc2a1a65c6cf', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:53:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-d9afd8dc-419a-4857-94ff-41c71d5e88bd req-eec339b4-525b-42e8-a28a-33eae66a2a42 tempest-TestShelveInstance-1320791387 None] attachment_update completed successfully. Sep 15 18:53:52 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737 1073741824" returned: 0 in 0.734s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:52 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737 Sep 15 18:53:52 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:52 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737" returned: 0 in 0.482s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e05414-f297-47a2-b37f-8417f0c17edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b45e890-8b9c-409a-a545-b38430029737', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5881ccc-cc73-4f80-9e35-a6810da24d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:52 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Volume volume-4b45e890-8b9c-409a-a545-b38430029737 (4b45e890-8b9c-409a-a545-b38430029737): created successfully Sep 15 18:53:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5881ccc-cc73-4f80-9e35-a6810da24d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Flow 'volume_create_manager' (71253dd6-bc46-4fac-bd7b-2f2e2d3a3135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d778be28-de4c-4af8-941a-fa7cd44d777f tempest-VolumesListAdminTestJSON-319839391 None] Created volume successfully. Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Acquiring lock "cinder-2dba0745-8998-4291-99b6-8da283e74944-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Lock "cinder-2dba0745-8998-4291-99b6-8da283e74944-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Acquiring lock "cinder-quobyte-2dba0745-8998-4291-99b6-8da283e74944" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Lock "cinder-quobyte-2dba0745-8998-4291-99b6-8da283e74944" acquired by "delete_volume" :: waited 0.039s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a345c4-6d44-433a-bb97-74fb600077f0]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Flow 'volume_create_manager' (5327336d-ff95-49c2-b68e-a3376734c36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b442721a-19d5-4a71-a736-ae9f97da2536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b442721a-19d5-4a71-a736-ae9f97da2536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1fd8f7-1446-4087-909a-0cb27d168def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660398b5d44746da8d307fb94e31df9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:55Z,use_quota=True,user_id='99a51de901764bffa7c27645a0b3e247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16f47f7-8525-4436-a094-029a2b8ac3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16f47f7-8525-4436-a094-029a2b8ac3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67ef1f9-20e7-44f4-a8cb-6abadf93af16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67ef1f9-20e7-44f4-a8cb-6abadf93af16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db1fd8f7-1446-4087-909a-0cb27d168def', 'volume_name': 'volume-db1fd8f7-1446-4087-909a-0cb27d168def', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcb8ad6-06ef-4cf9-a278-b3585890c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdcb8ad6-06ef-4cf9-a278-b3585890c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:55 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944 Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacb2b81-094a-4465-8cf7-e84718f0f637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:55 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Volume db1fd8f7-1446-4087-909a-0cb27d168def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db1fd8f7-1446-4087-909a-0cb27d168def', 'volume_size': 1} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db1fd8f7-1446-4087-909a-0cb27d168def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='660398b5d44746da8d307fb94e31df9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:53:55Z,use_quota=True,user_id='99a51de901764bffa7c27645a0b3e247',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Creating volume db1fd8f7-1446-4087-909a-0cb27d168def {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:55 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:53:55 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:55 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def 1073741824 Sep 15 18:53:55 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:55 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944" returned: 0 in 1.007s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:55 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944 Sep 15 18:53:55 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:56 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def 1073741824" returned: 0 in 1.227s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:56 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def Sep 15 18:53:56 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:56 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2dba0745-8998-4291-99b6-8da283e74944" returned: 0 in 0.888s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Lock "cinder-quobyte-2dba0745-8998-4291-99b6-8da283e74944" released by "delete_volume" :: held 2.018s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:56 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Created reservations ['de263c2b-9a79-40d3-9e0e-daa72cc7931c', 'f966d49b-6eea-4f7b-b0be-5b64b20bf6fa', 'f82c1379-3c1c-4fe3-98a6-3a63bb923b7a', '73f5e767-cda1-4935-99c0-540cb2cd2e82'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:56 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def" returned: 0 in 0.655s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Acquiring lock "cinder-985a76cf-c416-45d6-b2a5-56e786ceb31f-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:57 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacb2b81-094a-4465-8cf7-e84718f0f637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db1fd8f7-1446-4087-909a-0cb27d168def', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:57 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6208c503-2abf-4a9f-90a8-6ba9f43be518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Lock "cinder-985a76cf-c416-45d6-b2a5-56e786ceb31f-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:57 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Volume volume-db1fd8f7-1446-4087-909a-0cb27d168def (db1fd8f7-1446-4087-909a-0cb27d168def): created successfully Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6208c503-2abf-4a9f-90a8-6ba9f43be518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Flow 'volume_create_manager' (5327336d-ff95-49c2-b68e-a3376734c36e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:53:57 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-50fb7305-a3ec-4809-beb2-3b3a4c6019e7 tempest-VolumesListAdminTestJSON-735828244 None] Created volume successfully. Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Acquiring lock "cinder-quobyte-985a76cf-c416-45d6-b2a5-56e786ceb31f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Lock "cinder-quobyte-985a76cf-c416-45d6-b2a5-56e786ceb31f" acquired by "delete_volume" :: waited 0.048s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4e131c-065d-4487-a1ac-82bb8d31b876]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:57 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.669s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:53:57 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Deleted volume successfully. Sep 15 18:53:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-31f5fffd-b8f9-4f06-b6f9-8a1765a476aa tempest-VolumesTestJSON-11834630 None] Lock "cinder-2dba0745-8998-4291-99b6-8da283e74944-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:57 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f Sep 15 18:53:57 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:58 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f" returned: 0 in 0.670s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:58 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f Sep 15 18:53:58 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Acquiring lock "cinder-db1fd8f7-1446-4087-909a-0cb27d168def-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Lock "cinder-db1fd8f7-1446-4087-909a-0cb27d168def-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Acquiring lock "cinder-quobyte-db1fd8f7-1446-4087-909a-0cb27d168def" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Lock "cinder-quobyte-db1fd8f7-1446-4087-909a-0cb27d168def" acquired by "delete_volume" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d8decc-e072-4102-bf1b-4222658acf31]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "cinder-4b45e890-8b9c-409a-a545-b38430029737-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-4b45e890-8b9c-409a-a545-b38430029737-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "cinder-quobyte-4b45e890-8b9c-409a-a545-b38430029737" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-quobyte-4b45e890-8b9c-409a-a545-b38430029737" acquired by "delete_volume" :: waited 0.047s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:53:58 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def Sep 15 18:53:58 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:59 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93b43c0-43e2-4d9b-9cc3-7698f8e676f7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-985a76cf-c416-45d6-b2a5-56e786ceb31f" returned: 0 in 0.871s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Lock "cinder-quobyte-985a76cf-c416-45d6-b2a5-56e786ceb31f" released by "delete_volume" :: held 1.679s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Created reservations ['fea04786-0a61-4f7a-bae2-b4ab1ad2f7ed', '5abf59c2-2998-4d0b-88a5-891ce8d79f9c', '1b832bc1-be93-493a-9be7-fb44df74b833', '7cf76d1c-95a8-4095-8c62-b68995c5c4ae'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:53:59 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737 Sep 15 18:53:59 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:59 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:53:59 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:53:59 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def" returned: 0 in 1.147s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:53:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Acquiring lock "cinder-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:53:59 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def Sep 15 18:53:59 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Lock "cinder-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:00 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:00 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737" returned: 0 in 0.997s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.471s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:00 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737 Sep 15 18:54:00 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Deleted volume successfully. Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0bf99b11-4c9b-493f-870c-9f02b09879d5 tempest-VolumesTestJSON-11834630 None] Lock "cinder-985a76cf-c416-45d6-b2a5-56e786ceb31f-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Acquiring lock "cinder-quobyte-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Lock "cinder-quobyte-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc" acquired by "delete_volume" :: waited 0.074s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a593488-00d1-4bae-9159-029e6d21c2f1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:00 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db1fd8f7-1446-4087-909a-0cb27d168def" returned: 0 in 0.785s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Lock "cinder-quobyte-db1fd8f7-1446-4087-909a-0cb27d168def" released by "delete_volume" :: held 2.032s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:DELETE=15,cinder:SELECT=134,cinder:INSERT=62,cinder:UPDATE=201 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:54:00 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc Sep 15 18:54:00 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:00 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Created reservations ['edc583a4-f0c1-4d44-aaf5-26707620f5e9', '33ced280-cd17-42b5-b76d-10fdb8479e97', 'c6d025fc-6295-4f71-a09a-c75e2de7cb84', 'f59cd522-d5e2-4e89-b47a-8e616eca32f6'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:01 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b45e890-8b9c-409a-a545-b38430029737" returned: 0 in 0.887s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-quobyte-4b45e890-8b9c-409a-a545-b38430029737" released by "delete_volume" :: held 2.103s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:01 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:01 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Created reservations ['ef6752e0-9d25-4fd9-bc9a-dd9158bb17b8', '541de43e-d001-464e-bc7c-6ce9dc46b3d9', 'adb5f08b-5c0e-4c0f-bcc2-d3d86eb3cb77', 'cc0df6f4-f566-4747-9604-7570c341d903'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:01 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.400s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:01 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Deleted volume successfully. Sep 15 18:54:01 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc" returned: 0 in 1.102s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-59d9dd43-b1ba-4e23-a559-f6dea4e5af4a tempest-VolumesListAdminTestJSON-735828244 None] Lock "cinder-db1fd8f7-1446-4087-909a-0cb27d168def-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:01 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc Sep 15 18:54:01 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:01 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:01 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:02 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc" returned: 0 in 0.464s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Lock "cinder-quobyte-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc" released by "delete_volume" :: held 1.661s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=156,cinder:UPDATE=176,cinder:INSERT=42,cinder:DELETE=21 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Created reservations ['929ef35c-a9bd-42ca-8e17-0d3140e39f17', '41d1da77-d584-45ab-8555-6fcbf3e1a31e', 'e71690ff-b3f6-498d-b555-eda5b3377687', '049ffb8a-415f-4ad5-bd84-559105976225'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:02 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.587s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Deleted volume successfully. Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72af9807-a9ae-46fe-a5c8-eccd8bb6e3ef tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-4b45e890-8b9c-409a-a545-b38430029737-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:02 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:02 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "cinder-53ebc293-2131-40cf-9055-bb28349a84c6-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-53ebc293-2131-40cf-9055-bb28349a84c6-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:02 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.466s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Deleted volume successfully. Sep 15 18:54:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "cinder-quobyte-53ebc293-2131-40cf-9055-bb28349a84c6" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-quobyte-53ebc293-2131-40cf-9055-bb28349a84c6" acquired by "delete_volume" :: waited 0.047s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d69173df-3307-468e-a388-6a5f2db1302a tempest-VolumesTestJSON-11834630 None] Lock "cinder-b9d5e3d5-ce0f-43b5-b2a5-1ae6c85d64dc-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:03 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14bca51-6c26-494b-bee6-81b30a8c9f61]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:03 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6 Sep 15 18:54:03 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:03 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6" returned: 0 in 0.813s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:03 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6 Sep 15 18:54:03 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:04 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-53ebc293-2131-40cf-9055-bb28349a84c6" returned: 0 in 0.434s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-quobyte-53ebc293-2131-40cf-9055-bb28349a84c6" released by "delete_volume" :: held 1.345s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:04 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Created reservations ['3c920785-dfe4-4da2-832d-b3e3638fe2a3', '710c8c0a-9349-4f79-a274-04df5399455c', '7ecfec39-3f95-4939-8f60-d548c67ac5b0', '5d58cdbb-cda6-4bb6-bf69-8eefe0f3c024'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:04 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:04 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:05 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.431s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:05 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Deleted volume successfully. Sep 15 18:54:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a704c5c6-ab4f-4660-85ca-131ec2f6d07a tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-53ebc293-2131-40cf-9055-bb28349a84c6-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "cinder-6b8759a3-8489-4e50-8a4c-529d60040b06-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-6b8759a3-8489-4e50-8a4c-529d60040b06-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "cinder-quobyte-6b8759a3-8489-4e50-8a4c-529d60040b06" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-quobyte-6b8759a3-8489-4e50-8a4c-529d60040b06" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcda9af-48c9-4136-9818-91d5f6e9d1c2]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:05 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06 Sep 15 18:54:05 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:06 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06" returned: 0 in 0.552s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:06 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06 Sep 15 18:54:06 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:06 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6b8759a3-8489-4e50-8a4c-529d60040b06" returned: 0 in 0.509s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-quobyte-6b8759a3-8489-4e50-8a4c-529d60040b06" released by "delete_volume" :: held 1.121s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Created reservations ['ea9973f0-eb2d-4c93-be2f-359f6d955b91', 'e9837230-cf3d-4ff6-89ab-fb7e45c485e9', 'c2d512b9-77cf-4777-977a-9390dfdd0109', '446aebeb-99a2-4a21-a845-029efe687d6a'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:06 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:06 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:07 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.395s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:07 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Deleted volume successfully. Sep 15 18:54:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e99744e8-fd24-451e-9245-dbc29d7cb18e tempest-VolumesListAdminTestJSON-319839391 None] Lock "cinder-6b8759a3-8489-4e50-8a4c-529d60040b06-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Acquiring lock "cinder-edc99cfd-371d-484e-beeb-bfb495bd2c10-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Lock "cinder-edc99cfd-371d-484e-beeb-bfb495bd2c10-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Acquiring lock "cinder-quobyte-edc99cfd-371d-484e-beeb-bfb495bd2c10" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Lock "cinder-quobyte-edc99cfd-371d-484e-beeb-bfb495bd2c10" acquired by "delete_volume" :: waited 0.040s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:13 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2477e9-e12d-4e94-8207-3cc8bfd14168]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:13 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 Sep 15 18:54:13 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:14 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10" returned: 0 in 0.435s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:14 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10 Sep 15 18:54:14 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:14 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-edc99cfd-371d-484e-beeb-bfb495bd2c10" returned: 0 in 0.317s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Lock "cinder-quobyte-edc99cfd-371d-484e-beeb-bfb495bd2c10" released by "delete_volume" :: held 0.812s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Created reservations ['6b80b7df-2c67-4c72-8061-bedbe3c259a5', '1c25486b-127e-4323-a402-d6ba48004015', '25b3333e-67f8-4095-a983-136f95af8a05', '9b2678ff-02c8-4a71-afa8-dcae5dc93689'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:14 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:14 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:15 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.450s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Deleted volume successfully. Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-46dac90d-44d9-44a7-98dc-c2966ed3f12a tempest-VolumesNegativeTest-297430659 None] Lock "cinder-edc99cfd-371d-484e-beeb-bfb495bd2c10-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Flow 'volume_create_manager' (accad2f8-6e50-406b-81a6-af4190cab604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffb3cd3-996d-4629-89d6-f3fca1e572c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dffb3cd3-996d-4629-89d6-f3fca1e572c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-858894921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a973ac1d-5f92-4d15-a4df-dbf36b7e048d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc72919d81014644bdefbd6efbce0568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:15Z,use_quota=True,user_id='20ae6e600dec4ed1a2cc3ee3f3d616b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3d5967-90e7-478f-b30d-801c260be89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3d5967-90e7-478f-b30d-801c260be89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1e2ab1-7bcd-4ea7-9177-c8c30c1bb2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d1e2ab1-7bcd-4ea7-9177-c8c30c1bb2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a973ac1d-5f92-4d15-a4df-dbf36b7e048d', 'volume_name': 'volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2656adf8-3250-4e78-91d7-596e4eb2cd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2656adf8-3250-4e78-91d7-596e4eb2cd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de9a59b-0876-4dbd-979d-3a6def59d377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:15 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Volume a973ac1d-5f92-4d15-a4df-dbf36b7e048d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d', 'volume_size': 1} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-858894921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a973ac1d-5f92-4d15-a4df-dbf36b7e048d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc72919d81014644bdefbd6efbce0568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:15Z,use_quota=True,user_id='20ae6e600dec4ed1a2cc3ee3f3d616b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Creating volume a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:54:15 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:54:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:15 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d 1073741824 Sep 15 18:54:15 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:16 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d 1073741824" returned: 0 in 0.648s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:16 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d Sep 15 18:54:16 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:16 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" returned: 0 in 0.426s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:54:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de9a59b-0876-4dbd-979d-3a6def59d377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a951779f-6625-482c-abf0-8b6358bd9646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:16 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Volume volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d (a973ac1d-5f92-4d15-a4df-dbf36b7e048d): created successfully Sep 15 18:54:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a951779f-6625-482c-abf0-8b6358bd9646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Flow 'volume_create_manager' (accad2f8-6e50-406b-81a6-af4190cab604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:16 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6c261d22-5b96-42a7-8326-1944fc1e7315 tempest-VolumesDeleteCascade-923889925 None] Created volume successfully. Sep 15 18:54:17 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-27231eb4-6852-454a-9608-345c5ebe63b5 tempest-GroupSnapshotsV319Test-407591678 None] Group tempest-GroupSnapshotsV319Test-Group-639840992: creating Sep 15 18:54:17 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-27231eb4-6852-454a-9608-345c5ebe63b5 tempest-GroupSnapshotsV319Test-407591678 None] Group tempest-GroupSnapshotsV319Test-Group-639840992: created successfully Sep 15 18:54:17 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-27231eb4-6852-454a-9608-345c5ebe63b5 tempest-GroupSnapshotsV319Test-407591678 None] Create group completed successfully. Sep 15 18:54:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Creating offline snapshot fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd of volume a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:54:17 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f62dfe-0593-4219-bdf8-864f725fe602]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:18 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d Sep 15 18:54:18 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:18 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" returned: 0 in 0.398s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:18 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd 1G Sep 15 18:54:18 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:18 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd 1G" returned: 0 in 0.438s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:18 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd Sep 15 18:54:18 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:19 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" returned: 0 in 0.346s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:19 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd is being set with open permissions: ugo+rw Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:19 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd Sep 15 18:54:19 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:19 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" returned: 0 in 0.291s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:19 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.info Sep 15 18:54:19 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Flow 'volume_create_manager' (2325a109-0bee-4ec0-89f2-597585f37df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d993c6fa-962e-441d-8d6b-0ce0ddc86210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d993c6fa-962e-441d-8d6b-0ce0ddc86210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-302032273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e2a38b-86da-43c7-a554-ccd0ba40cf12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0c988553e741438a8926125c156630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:19Z,use_quota=True,user_id='ffcc3404cb6d479ab5625acf74c205b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95072cd2-ee94-4e63-aa3d-1f8a2d5ec15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95072cd2-ee94-4e63-aa3d-1f8a2d5ec15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16052905-c297-41bd-97b8-21f8db2af196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16052905-c297-41bd-97b8-21f8db2af196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e2a38b-86da-43c7-a554-ccd0ba40cf12', 'volume_name': 'volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75980796-6ba6-48cd-ba4b-2a83b3180b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75980796-6ba6-48cd-ba4b-2a83b3180b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4be868f-44ec-4575-ba35-4368d8880c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Volume 97e2a38b-86da-43c7-a554-ccd0ba40cf12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12', 'volume_size': 1} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Flow 'volume_create_manager' (f3730c97-e8da-4645-921b-5c1a7df119f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dfd576-463c-4608-84bb-d4d6e269ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dfd576-463c-4608-84bb-d4d6e269ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2090266681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc00d87e-e2ae-4c8f-b82a-e509782c39d7,host='devstack@QuobyteHD#QuobyteHD',id=8aa11b35-5847-481b-928e-6bc0ff664a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807b7b45b2324199947066725d348368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:19Z,use_quota=True,user_id='a428cdf985774eabbe04de09b0feb0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e54db25-7740-4d80-8774-f4d5ec5444d2),volume_type_id=5e54db25-7740-4d80-8774-f4d5ec5444d2)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ab724a-69e8-4f6d-ade5-e39898823bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ab724a-69e8-4f6d-ade5-e39898823bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ee94ba-4769-4a44-89a0-353b566a4e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ee94ba-4769-4a44-89a0-353b566a4e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa11b35-5847-481b-928e-6bc0ff664a5d', 'volume_name': 'volume-8aa11b35-5847-481b-928e-6bc0ff664a5d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43fe3fa-e92e-4216-80e6-f6529a33c028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c43fe3fa-e92e-4216-80e6-f6529a33c028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a56e56-14c7-4e56-b36e-b61e91e92678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:19 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Volume 8aa11b35-5847-481b-928e-6bc0ff664a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa11b35-5847-481b-928e-6bc0ff664a5d', 'volume_size': 1} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:19 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.info" returned: 0 in 0.278s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:19 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.info is being set with open permissions: ugo+rw Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:19 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.info Sep 15 18:54:19 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:19 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.info" returned: 0 in 0.241s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-302032273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e2a38b-86da-43c7-a554-ccd0ba40cf12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0c988553e741438a8926125c156630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:19Z,use_quota=True,user_id='ffcc3404cb6d479ab5625acf74c205b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Creating volume 97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:54:19 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:54:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:19 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 1073741824 Sep 15 18:54:19 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:19 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-adac437a-bcd0-4858-8e97-d544e0f38c8a tempest-VolumesDeleteCascade-923889925 None] Create snapshot completed successfully Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:20 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 1073741824" returned: 0 in 0.508s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:20 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 Sep 15 18:54:20 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:20 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12" returned: 0 in 0.238s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.065s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bc00d87e-e2ae-4c8f-b82a-e509782c39d7,created_at=2026-09-15T16:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2090266681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bc00d87e-e2ae-4c8f-b82a-e509782c39d7,host='devstack@QuobyteHD#QuobyteHD',id=8aa11b35-5847-481b-928e-6bc0ff664a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807b7b45b2324199947066725d348368',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:19Z,use_quota=True,user_id='a428cdf985774eabbe04de09b0feb0fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e54db25-7740-4d80-8774-f4d5ec5444d2),volume_type_id=5e54db25-7740-4d80-8774-f4d5ec5444d2)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Creating volume 8aa11b35-5847-481b-928e-6bc0ff664a5d {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:54:20 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:20 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d 1073741824 Sep 15 18:54:20 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4be868f-44ec-4575-ba35-4368d8880c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8af1342-4aec-4e6b-9ebc-5aff18871d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:20 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Volume volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 (97e2a38b-86da-43c7-a554-ccd0ba40cf12): created successfully Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8af1342-4aec-4e6b-9ebc-5aff18871d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Flow 'volume_create_manager' (2325a109-0bee-4ec0-89f2-597585f37df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:20 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-194ac692-8a7f-4157-ab3a-dec7781e13e6 tempest-VolumesSnapshotListTestJSON-148978594 None] Created volume successfully. Sep 15 18:54:21 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d 1073741824" returned: 0 in 0.474s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:21 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d Sep 15 18:54:21 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:21 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d" returned: 0 in 0.260s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.104s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a56e56-14c7-4e56-b36e-b61e91e92678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa11b35-5847-481b-928e-6bc0ff664a5d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c0886d-57ce-4584-9a2c-3f4333c385f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Creating offline snapshot c20ede9e-1db0-4264-90fe-d684d11cd6c9 of volume a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f77d8f-5f1b-4dd4-a011-0476d5f1d5c8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:21 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Volume volume-8aa11b35-5847-481b-928e-6bc0ff664a5d (8aa11b35-5847-481b-928e-6bc0ff664a5d): created successfully Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c0886d-57ce-4584-9a2c-3f4333c385f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Flow 'volume_create_manager' (f3730c97-e8da-4645-921b-5c1a7df119f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:21 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-11b45f42-8f58-4b6e-8dd2-097c312ed187 tempest-GroupSnapshotsV319Test-407591678 None] Created volume successfully. Sep 15 18:54:21 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd Sep 15 18:54:21 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:22 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" returned: 0 in 0.369s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:22 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 1G Sep 15 18:54:22 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:22 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 1G" returned: 0 in 0.445s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:22 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 Sep 15 18:54:22 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:22 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9" returned: 0 in 0.289s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:22 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 is being set with open permissions: ugo+rw Sep 15 18:54:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:22 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 Sep 15 18:54:22 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:22 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9" returned: 0 in 0.249s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.524s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.377s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Creating offline snapshot 5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 of volume 97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:54:23 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-173f2419-408a-40d9-aeb0-950d51f0aebf tempest-VolumesDeleteCascade-923889925 None] Create snapshot completed successfully Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[491776ff-a768-4877-a152-0c03a7c20800]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:23 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] GroupSnapshot 45a72247-b3d9-407e-8125-0a4fd6721686: creating. Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Group snapshot 45a72247-b3d9-407e-8125-0a4fd6721686: creating. {{(pid=86137) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:23 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 Sep 15 18:54:23 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:23 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12" returned: 0 in 0.376s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:23 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 1G Sep 15 18:54:23 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-a973ac1d-5f92-4d15-a4df-dbf36b7e048d-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-a973ac1d-5f92-4d15-a4df-dbf36b7e048d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Performing cascade delete. {{(pid=86137) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-c20ede9e-1db0-4264-90fe-d684d11cd6c9-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-c20ede9e-1db0-4264-90fe-d684d11cd6c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-c20ede9e-1db0-4264-90fe-d684d11cd6c9" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-c20ede9e-1db0-4264-90fe-d684d11cd6c9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Deleting offline snapshot c20ede9e-1db0-4264-90fe-d684d11cd6c9 of volume a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] snapshot_file for this snap is: volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[61721cc2-8474-4d4d-bca8-e4f727195179]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:23 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 1G" returned: 0 in 0.435s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:23 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 Sep 15 18:54:23 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:23 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 Sep 15 18:54:23 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:24 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9" returned: 0 in 0.403s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:24 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" returned: 0 in 0.309s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:24 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 is being set with open permissions: ugo+rw Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[662b4d49-744b-4c93-94fb-f0c2d18262c6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:24 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 Sep 15 18:54:24 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:24 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd Sep 15 18:54:24 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:24 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" returned: 0 in 0.254s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:24 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.info Sep 15 18:54:24 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:24 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" returned: 0 in 0.373s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:24 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 Sep 15 18:54:24 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:24 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.info" returned: 0 in 0.284s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:24 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.info is being set with open permissions: ugo+rw Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:24 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.info Sep 15 18:54:24 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:24 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9" returned: 0 in 0.381s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:25 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9 Sep 15 18:54:25 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:25 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.info" returned: 0 in 0.254s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.944s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Creating offline snapshot 8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 of volume 8aa11b35-5847-481b-928e-6bc0ff664a5d {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:54:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a9848482-2871-43ce-b98e-07fb75dfd9c9 tempest-VolumesSnapshotListTestJSON-148978594 None] Create snapshot completed successfully Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[db540405-c7e0-4044-a3f6-c8db44acfc57]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:25 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d Sep 15 18:54:25 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:25 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.c20ede9e-1db0-4264-90fe-d684d11cd6c9" returned: 0 in 0.307s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-c20ede9e-1db0-4264-90fe-d684d11cd6c9" released by "_delete_snapshot" :: held 1.578s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" released by "delete_snapshot" :: held 1.605s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Created reservations ['bd6e4e46-870c-436f-9c04-8ed8284f0488', 'f59381cd-dfa9-4e1e-b3e2-8f1bd8994f45', '0b309c4e-0047-4937-a352-6c209440ffb0', '2ef5092f-757c-4157-8203-0fb086d403f7'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Delete snapshot completed successfully. Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-c20ede9e-1db0-4264-90fe-d684d11cd6c9-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Deleting offline snapshot fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd of volume a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:54:25 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] snapshot_file for this snap is: volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d" returned: 0 in 0.484s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[19347ee0-2565-417b-a799-9612f5cd1b22]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:25 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 1G Sep 15 18:54:25 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:25 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd Sep 15 18:54:25 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:26 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" returned: 0 in 0.479s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c468ab-03af-4437-bf97-a2bce1249948]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:26 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 1G" returned: 0 in 0.583s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa11b35-5847-481b-928e-6bc0ff664a5d -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:26 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa11b35-5847-481b-928e-6bc0ff664a5d -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 Sep 15 18:54:26 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:26 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d Sep 15 18:54:26 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:26 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8aa11b35-5847-481b-928e-6bc0ff664a5d -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8" returned: 0 in 0.337s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:26 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:26 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" returned: 0 in 0.408s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:26 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 Sep 15 18:54:26 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:26 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd Sep 15 18:54:26 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:26 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8" returned: 0 in 0.271s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:26 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.info Sep 15 18:54:26 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:26 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" returned: 0 in 0.360s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:26 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd Sep 15 18:54:26 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:27 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.info" returned: 0 in 0.294s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:27 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:27 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.info Sep 15 18:54:27 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:27 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d.fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" returned: 0 in 0.285s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd" released by "_delete_snapshot" :: held 1.661s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" released by "delete_snapshot" :: held 1.692s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Created reservations ['6920990b-2247-41ec-b27a-b4e5784adb64', 'efc232d2-a03a-4ab7-9636-79a2b45f3364', '5d9b6185-3fa7-4b0d-901f-0f58029c0e0c', '9bebc735-3aa0-4d0c-926a-243c91756288'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:27 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Delete snapshot completed successfully. Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-fd5bb1b2-887a-4f7e-81ab-27f273f3f4dd-delete_snapshot" released by "delete_snapshot" :: held 1.906s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Snapshots deleted, issuing volume delete {{(pid=86137) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:27 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.info" returned: 0 in 0.308s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" acquired by "delete_volume" :: waited 0.037s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.411s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18f0f5b-0bc2-4aef-ab43-d140c5f0b217]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Creating offline snapshot 55067355-8cbf-4f95-aada-285b011fa9c4 of volume 97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bdb4b5-231a-46a5-a1f8-dd2ad4f12d04]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:27 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d Sep 15 18:54:27 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:27 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1abf9019-c40c-4f6d-8c45-09ecfb6e5563 tempest-GroupSnapshotsV319Test-407591678 None] group_snapshot 45a72247-b3d9-407e-8125-0a4fd6721686: created successfully Sep 15 18:54:27 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 Sep 15 18:54:27 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:27 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" returned: 0 in 0.413s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:27 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d Sep 15 18:54:27 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:28 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" returned: 0 in 0.439s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:28 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 1G Sep 15 18:54:28 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:28 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" returned: 0 in 0.245s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-a973ac1d-5f92-4d15-a4df-dbf36b7e048d" released by "delete_volume" :: held 0.739s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Created reservations ['e99387a1-ecf0-41d2-995e-35d28cd44f8a', 'e682646a-ba76-4b9a-89b5-2547ee568b5f', '696354cc-de0b-4416-b6e9-b9b0b2b3109c', 'b7670d37-697f-490c-9efb-902b75f9a473'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:28 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:28 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:28 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.296s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Deleted volume successfully. Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-340f5b22-04e2-40f7-aed3-15c87e77af74 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-a973ac1d-5f92-4d15-a4df-dbf36b7e048d-delete_volume" released by "delete_volume" :: held 5.032s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:28 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 1G" returned: 0 in 0.630s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:28 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 Sep 15 18:54:28 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] group_snapshot 45a72247-b3d9-407e-8125-0a4fd6721686: deleting Sep 15 18:54:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] group_snapshot 45a72247-b3d9-407e-8125-0a4fd6721686: deleting {{(pid=86137) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Acquiring lock "cinder-quobyte-8aa11b35-5847-481b-928e-6bc0ff664a5d" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Lock "cinder-quobyte-8aa11b35-5847-481b-928e-6bc0ff664a5d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Acquiring lock "cinder-quobyte-8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Lock "cinder-quobyte-8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Deleting offline snapshot 8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 of volume 8aa11b35-5847-481b-928e-6bc0ff664a5d {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:54:29 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] snapshot_file for this snap is: volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4" returned: 0 in 0.423s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:29 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 is being set with open permissions: ugo+rw Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab6b9f6-1f93-4431-81ff-ac149f72c514]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:29 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 Sep 15 18:54:29 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:29 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 Sep 15 18:54:29 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:29 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4" returned: 0 in 0.413s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:29 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8" returned: 0 in 0.459s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8aa11b35-5847-481b-928e-6bc0ff664a5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720b8dd-d4ce-4bec-93c7-18d4ea1380b0]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-37d517b6-0fc4-4f87-b84c-78253cf6a4b9 tempest-VolumesSnapshotListTestJSON-148978594 None] Create snapshot completed successfully Sep 15 18:54:29 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d Sep 15 18:54:29 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:30 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d" returned: 0 in 0.490s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:30 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 Sep 15 18:54:30 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Flow 'volume_create_manager' (c57dbef4-3c2b-4326-932c-2e7067bea794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4840c44d-cdfb-4a53-8219-fc28b87f8c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4840c44d-cdfb-4a53-8219-fc28b87f8c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1873149304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a25c20-107d-41db-b3ed-d616a347bf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc72919d81014644bdefbd6efbce0568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:30Z,use_quota=True,user_id='20ae6e600dec4ed1a2cc3ee3f3d616b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b74458b-3b11-4687-a772-5e687531c161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b74458b-3b11-4687-a772-5e687531c161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f86b730-7235-47ed-89a7-74b0098d7a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f86b730-7235-47ed-89a7-74b0098d7a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a25c20-107d-41db-b3ed-d616a347bf0c', 'volume_name': 'volume-e3a25c20-107d-41db-b3ed-d616a347bf0c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b579f6-24f8-4917-bd22-277e1d6b8a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b579f6-24f8-4917-bd22-277e1d6b8a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f764f3-43af-425f-8270-1601bf60111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:30 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Volume e3a25c20-107d-41db-b3ed-d616a347bf0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a25c20-107d-41db-b3ed-d616a347bf0c', 'volume_size': 1} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1873149304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a25c20-107d-41db-b3ed-d616a347bf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc72919d81014644bdefbd6efbce0568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:30Z,use_quota=True,user_id='20ae6e600dec4ed1a2cc3ee3f3d616b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Creating volume e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:54:30 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:30 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c 1073741824 Sep 15 18:54:30 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:30 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8" returned: 0 in 0.511s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:30 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8 Sep 15 18:54:30 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:30 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c 1073741824" returned: 0 in 0.639s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:30 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d.8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8" returned: 0 in 0.331s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Lock "cinder-quobyte-8c0f10d7-c4a0-4ffb-b22c-61cddb6ff2d8" released by "_delete_snapshot" :: held 1.961s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Lock "cinder-quobyte-8aa11b35-5847-481b-928e-6bc0ff664a5d" released by "delete_snapshot" :: held 1.991s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:31 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c Sep 15 18:54:31 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:31 devstack cinder-volume[86137]: WARNING cinder.quota [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-327373496 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-327373496, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:54:31 devstack cinder-volume[86137]: WARNING cinder.quota [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-327373496 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-327373496, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] Created reservations ['c7d581f9-4206-47b6-a4b5-7cb3ebf7f07e', 'd05acdab-d656-456e-b168-277d3bf93f6b', 'ec6ece68-cf3d-40b9-9adf-3ad0cc8732d4', '9f5e7994-bc4f-40f5-aea5-4b48b3fdae88'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0912243b-9f06-4dd1-9472-c62ab1011750 tempest-GroupSnapshotsV319Test-407591678 None] group_snapshot 45a72247-b3d9-407e-8125-0a4fd6721686: deleted successfully Sep 15 18:54:31 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c" returned: 0 in 0.278s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.725s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f764f3-43af-425f-8270-1601bf60111a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a25c20-107d-41db-b3ed-d616a347bf0c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051d8ad8-c036-482a-9f57-8448f2423533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Creating offline snapshot 74bf7ebd-22f1-440e-b1a8-38ddd729173e of volume 97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:54:31 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Volume volume-e3a25c20-107d-41db-b3ed-d616a347bf0c (e3a25c20-107d-41db-b3ed-d616a347bf0c): created successfully Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051d8ad8-c036-482a-9f57-8448f2423533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Flow 'volume_create_manager' (c57dbef4-3c2b-4326-932c-2e7067bea794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef10bac-b048-4895-9900-b6e58035a622]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d89d5369-74d0-43c1-b0ea-e04aea6c5fb0 tempest-VolumesDeleteCascade-923889925 None] Created volume successfully. Sep 15 18:54:31 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 Sep 15 18:54:31 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Acquiring lock "cinder-quobyte-8aa11b35-5847-481b-928e-6bc0ff664a5d" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Lock "cinder-quobyte-8aa11b35-5847-481b-928e-6bc0ff664a5d" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb17ee8-88d0-4889-add0-7f67138c7f65]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:31 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4" returned: 0 in 0.392s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:31 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e 1G Sep 15 18:54:31 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:31 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d Sep 15 18:54:31 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:32 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d" returned: 0 in 0.422s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:32 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d Sep 15 18:54:32 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:32 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8aa11b35-5847-481b-928e-6bc0ff664a5d" returned: 0 in 0.435s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Lock "cinder-quobyte-8aa11b35-5847-481b-928e-6bc0ff664a5d" released by "delete_volume" :: held 0.978s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:32 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e 1G" returned: 0 in 1.042s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:32 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Created reservations ['a87e5f65-dd79-4ea4-a619-2b8a381cc2d7'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:32 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e Sep 15 18:54:32 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:32 devstack cinder-volume[86137]: WARNING cinder.quota [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-327373496 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-327373496, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:54:32 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Created reservations ['079d7a90-1cda-4111-97b6-7a06cdc9c72f', '071474e2-6d62-4eed-b09b-1ea7faaafeb6', '5f3a3512-e432-4be5-aa07-e13794c1393f', '61456dff-e066-4303-ac46-6b64a8b5c8d9'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-70c207ab-e081-4779-b65c-a6f5f458254d req-33a1f263-266e-4ea3-9e3a-da32fb962a32 tempest-TestShelveInstance-1320791387 None] Terminate volume connection completed successfully. Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-70c207ab-e081-4779-b65c-a6f5f458254d req-33a1f263-266e-4ea3-9e3a-da32fb962a32 tempest-TestShelveInstance-1320791387 None] Deleting attachment 1401a89c-ae7f-472a-ab8a-cc2a1a65c6cf. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:33 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:33 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:33 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e" returned: 0 in 0.367s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:33 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e is being set with open permissions: ugo+rw Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:33 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e Sep 15 18:54:33 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:33 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.284s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0271e856-c329-4089-8398-d96e2a5235a6 tempest-GroupSnapshotsV319Test-407591678 None] Delete group completed successfully. Sep 15 18:54:33 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e" returned: 0 in 0.304s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.300s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.738s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Creating offline snapshot 656b1d73-da29-4299-be50-3057aef7b5d5 of volume e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:54:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-eb8fb5bc-03a2-4701-8abd-3dd45aba9a19 tempest-VolumesSnapshotListTestJSON-148978594 None] Create snapshot completed successfully Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1ed69b-3e06-493e-b1cb-4ab38818f2dd]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:33 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c Sep 15 18:54:33 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:34 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c" returned: 0 in 0.554s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:34 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 1G Sep 15 18:54:34 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-74bf7ebd-22f1-440e-b1a8-38ddd729173e-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-74bf7ebd-22f1-440e-b1a8-38ddd729173e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-quobyte-74bf7ebd-22f1-440e-b1a8-38ddd729173e" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:34 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-74bf7ebd-22f1-440e-b1a8-38ddd729173e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Deleting offline snapshot 74bf7ebd-22f1-440e-b1a8-38ddd729173e of volume 97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] snapshot_file for this snap is: volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 1G" returned: 0 in 0.701s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a25c20-107d-41db-b3ed-d616a347bf0c -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d2bf6c-a38d-4cd1-bb9b-419f5f505717]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:34 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a25c20-107d-41db-b3ed-d616a347bf0c -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 Sep 15 18:54:34 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:35 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e Sep 15 18:54:35 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:35 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3a25c20-107d-41db-b3ed-d616a347bf0c -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5" returned: 0 in 0.516s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:35 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 is being set with open permissions: ugo+rw Sep 15 18:54:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:35 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 Sep 15 18:54:35 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:35 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e" returned: 0 in 0.724s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:35 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5b2c56-1b8a-48de-972b-fb22068aaf83]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:35 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5" returned: 0 in 0.397s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:35 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 Sep 15 18:54:35 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:35 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.info Sep 15 18:54:35 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-1654ae47-3c0b-432e-9fe5-feb02ac906a9 req-e520f9b4-6fbb-4e56-bf94-9fd94852e874 tempest-TestShelveInstance-1320791387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:36 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4" returned: 0 in 0.459s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:36 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e Sep 15 18:54:36 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:36 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.info" returned: 0 in 0.326s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:36 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.info is being set with open permissions: ugo+rw Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:36 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.info Sep 15 18:54:36 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:36 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.info" returned: 0 in 0.301s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.929s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-1654ae47-3c0b-432e-9fe5-feb02ac906a9 req-e520f9b4-6fbb-4e56-bf94-9fd94852e874 tempest-TestShelveInstance-1320791387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.559s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-1654ae47-3c0b-432e-9fe5-feb02ac906a9 req-e520f9b4-6fbb-4e56-bf94-9fd94852e874 tempest-TestShelveInstance-1320791387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:36 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d8b7d445-f3d1-4c6b-945b-41a0ad84c23e tempest-VolumesDeleteCascade-923889925 None] Create snapshot completed successfully Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-1654ae47-3c0b-432e-9fe5-feb02ac906a9 req-e520f9b4-6fbb-4e56-bf94-9fd94852e874 tempest-TestShelveInstance-1320791387 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51d0df88-5dbf-448e-942e-f45645a783ea', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:54:36 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e" returned: 0 in 0.457s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:36 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e Sep 15 18:54:36 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:36 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-1654ae47-3c0b-432e-9fe5-feb02ac906a9 req-e520f9b4-6fbb-4e56-bf94-9fd94852e874 tempest-TestShelveInstance-1320791387 None] attachment_update completed successfully. Sep 15 18:54:37 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.74bf7ebd-22f1-440e-b1a8-38ddd729173e" returned: 0 in 0.401s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-74bf7ebd-22f1-440e-b1a8-38ddd729173e" released by "_delete_snapshot" :: held 2.215s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" released by "delete_snapshot" :: held 2.258s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Created reservations ['1063eae7-bafe-45a5-a5a9-b0b3996bc692', 'fe3e17f1-a8cb-4cf9-bf48-86d20e1d7931', '514fc958-6ede-4678-bb17-9727276b317f', '06d7b719-5bce-43d3-a8a1-e31ac83b456d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Delete snapshot completed successfully. Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-2cf9e9a5-4a1b-49c5-a3bd-3155761cfbd5 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-74bf7ebd-22f1-440e-b1a8-38ddd729173e-delete_snapshot" released by "delete_snapshot" :: held 2.479s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Flow 'volume_create_manager' (fe36e4e7-2ef3-4efb-8dc0-52f6c06c93ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79f46e1-7a4e-47ac-a378-3d6c89492db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e79f46e1-7a4e-47ac-a378-3d6c89492db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1892732283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f60b59a2-c955-483f-9d64-aaa791089c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc72919d81014644bdefbd6efbce0568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=656b1d73-da29-4299-be50-3057aef7b5d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:38Z,use_quota=True,user_id='20ae6e600dec4ed1a2cc3ee3f3d616b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cbf833-3fcb-444e-b812-325fd1304096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70cbf833-3fcb-444e-b812-325fd1304096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20a37b1-7a70-48a2-87c1-0ff846ebafd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20a37b1-7a70-48a2-87c1-0ff846ebafd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f60b59a2-c955-483f-9d64-aaa791089c53', 'volume_name': 'volume-f60b59a2-c955-483f-9d64-aaa791089c53', 'volume_size': 1, 'snapshot_id': '656b1d73-da29-4299-be50-3057aef7b5d5'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33d344e-ebfb-4e74-be18-2414be7ecac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33d344e-ebfb-4e74-be18-2414be7ecac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7f9566-a416-42e6-8793-ea6f04da02ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:37 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Volume f60b59a2-c955-483f-9d64-aaa791089c53: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f60b59a2-c955-483f-9d64-aaa791089c53', 'volume_size': 1, 'snapshot_id': '656b1d73-da29-4299-be50-3057aef7b5d5'} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-656b1d73-da29-4299-be50-3057aef7b5d5-f60b59a2-c955-483f-9d64-aaa791089c53" by "_create_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-656b1d73-da29-4299-be50-3057aef7b5d5-f60b59a2-c955-483f-9d64-aaa791089c53" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Creating volume f60b59a2-c955-483f-9d64-aaa791089c53 from snapshot 656b1d73-da29-4299-be50-3057aef7b5d5 {{(pid=86137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-f60b59a2-c955-483f-9d64-aaa791089c53" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-55067355-8cbf-4f95-aada-285b011fa9c4-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-f60b59a2-c955-483f-9d64-aaa791089c53" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] snapshot: 656b1d73-da29-4299-be50-3057aef7b5d5, volume: f60b59a2-c955-483f-9d64-aaa791089c53, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-55067355-8cbf-4f95-aada-285b011fa9c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-quobyte-55067355-8cbf-4f95-aada-285b011fa9c4" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d009a-4b91-446b-90ba-74afb173fe51]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-55067355-8cbf-4f95-aada-285b011fa9c4" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Deleting offline snapshot 55067355-8cbf-4f95-aada-285b011fa9c4 of volume 97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] snapshot_file for this snap is: volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb19afae-cb6d-4da9-8c72-8f4d2e6fa868]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:38 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 Sep 15 18:54:38 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:38 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 Sep 15 18:54:38 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:38 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5" returned: 0 in 0.591s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3a25c20-107d-41db-b3ed-d616a347bf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be0e888-cda7-4a6d-8a97-5dd10a60b686]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:38 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4" returned: 0 in 0.567s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa472d82-3f85-4ae7-ba02-9634e35863e3]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:38 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c Sep 15 18:54:38 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:39 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 Sep 15 18:54:39 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:39 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c" returned: 0 in 0.504s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 18:54:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 18:54:39 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 18:54:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:39 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 Sep 15 18:54:39 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:39 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" returned: 0 in 0.511s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:39 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 Sep 15 18:54:39 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:40 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4" returned: 0 in 0.689s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:40 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4 Sep 15 18:54:40 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:41 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.55067355-8cbf-4f95-aada-285b011fa9c4" returned: 0 in 0.972s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-55067355-8cbf-4f95-aada-285b011fa9c4" released by "_delete_snapshot" :: held 3.020s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" released by "delete_snapshot" :: held 3.092s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:41 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Created reservations ['d3194210-5716-49d6-bb54-d389734e65b7', 'e3713ea0-d92f-454a-9b2c-c6e175b96b96', 'c9b60929-4ded-4ede-93d3-babff3ed2515', '22dc0fdd-d72b-435d-a473-5b835e734818'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:41 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Delete snapshot completed successfully. Sep 15 18:54:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dc8f2db1-c4a9-4ba2-9b7f-5b9372093862 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-55067355-8cbf-4f95-aada-285b011fa9c4-delete_snapshot" released by "delete_snapshot" :: held 3.567s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-quobyte-5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" acquired by "_delete_snapshot" :: waited 0.063s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Deleting offline snapshot 5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 of volume 97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] snapshot_file for this snap is: volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12c2b84-200d-4f9e-9b8c-6db1d82f2c8b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:43 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 Sep 15 18:54:43 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:43 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" returned: 0 in 0.933s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:44 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aca021-7fa0-4651-8b2a-6ec102149a51]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:44 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 Sep 15 18:54:44 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:45 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12" returned: 0 in 1.075s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:45 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 Sep 15 18:54:45 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:54:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:45 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:45 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-13404f70-45e9-43db-a2d3-510492be33d9 tempest-GroupsTest-1624623696 None] Group tempest-Group1-1262830612: creating Sep 15 18:54:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-13404f70-45e9-43db-a2d3-510492be33d9 tempest-GroupsTest-1624623696 None] Group tempest-Group1-1262830612: created successfully Sep 15 18:54:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-13404f70-45e9-43db-a2d3-510492be33d9 tempest-GroupsTest-1624623696 None] Create group completed successfully. Sep 15 18:54:46 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" returned: 0 in 1.422s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:46 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.775s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:54:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:54:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:54:46 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99 Sep 15 18:54:46 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:47 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12.5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" returned: 0 in 0.474s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99" released by "_delete_snapshot" :: held 4.301s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" released by "delete_snapshot" :: held 4.387s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:47 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Created reservations ['4297c1d8-47af-4ccb-9d70-598057923e7e', 'f5be359a-38c3-4b21-98b8-fb11e7593a71', 'c628d4bb-70f5-49a5-a7cb-76923c26e26f', '43204893-c197-46ff-b58a-177edbe74455'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Delete snapshot completed successfully. Sep 15 18:54:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30922ee6-337d-44db-a7fb-d43b6e47416e tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-5c37a6d6-28fa-4bf4-b6e4-7fb1f8b41f99-delete_snapshot" released by "delete_snapshot" :: held 4.863s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e7a11a61-0d59-4b02-9dfe-05c61e0aba28 tempest-GroupsTest-1624623696 None] Group tempest-Group2-1030463463: creating Sep 15 18:54:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e7a11a61-0d59-4b02-9dfe-05c61e0aba28 tempest-GroupsTest-1624623696 None] Group tempest-Group2-1030463463: created successfully Sep 15 18:54:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e7a11a61-0d59-4b02-9dfe-05c61e0aba28 tempest-GroupsTest-1624623696 None] Create group completed successfully. Sep 15 18:54:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-97e2a38b-86da-43c7-a554-ccd0ba40cf12-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-97e2a38b-86da-43c7-a554-ccd0ba40cf12-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:48 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c985bf-0104-42d8-9c84-e2a344b50902]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:49 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 Sep 15 18:54:49 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:49 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12" returned: 0 in 0.928s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:50 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12 Sep 15 18:54:50 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:50 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-97e2a38b-86da-43c7-a554-ccd0ba40cf12" returned: 0 in 0.568s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-quobyte-97e2a38b-86da-43c7-a554-ccd0ba40cf12" released by "delete_volume" :: held 1.797s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Flow 'volume_create_manager' (ebadf925-95c5-4b89-bd26-ba4b17694280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c87b95f-fe6e-4d2d-915a-14f091373810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c87b95f-fe6e-4d2d-915a-14f091373810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1982139922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=597d62c6-63d0-4f67-8685-37a0e3b67002,host='devstack@QuobyteHD#QuobyteHD',id=830c1599-9108-4f50-98cb-babe623b03cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc518df89b944addb41ec5bb502283db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:50Z,use_quota=True,user_id='8b511951b79a431194a9f9c96eba8c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bab2bc4-3188-4472-a941-2c5ca9ff653e),volume_type_id=0bab2bc4-3188-4472-a941-2c5ca9ff653e)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfe1067-35aa-4cf0-beee-dbe3bf188de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dfe1067-35aa-4cf0-beee-dbe3bf188de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b85a357-1dbd-46f7-a033-6f6046a0ef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b85a357-1dbd-46f7-a033-6f6046a0ef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830c1599-9108-4f50-98cb-babe623b03cc', 'volume_name': 'volume-830c1599-9108-4f50-98cb-babe623b03cc', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1f441e-dc5f-4223-beee-da7e3b0af697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f1f441e-dc5f-4223-beee-da7e3b0af697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f15057e-4b11-4809-8f59-a2c1ec9522f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:50 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Volume 830c1599-9108-4f50-98cb-babe623b03cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830c1599-9108-4f50-98cb-babe623b03cc', 'volume_size': 1} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:50 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Created reservations ['af5c7cde-b2e9-4703-aad5-56c662363d37', 'd0b0220b-d4df-40f3-97c1-03f2b6b56934', 'f002bd0c-c683-4587-bb49-04fa01abbb7f', '361d1628-af20-4f75-8db0-57f6ab23cba2'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:51 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:51 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:51 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53" returned: 0 in 11.853s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c, size 1024.00 MB, duration 11.85 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:54:51 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Converted 1024.00 MB image at 86.38 MB/s Sep 15 18:54:51 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 is being set with open permissions: ugo+rw Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:51 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 Sep 15 18:54:51 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:51 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.351s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Deleted volume successfully. Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-93779ec3-79c3-4bfa-ad75-a3cbf55daa50 tempest-VolumesSnapshotListTestJSON-148978594 None] Lock "cinder-97e2a38b-86da-43c7-a554-ccd0ba40cf12-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:51 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53" returned: 0 in 0.352s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-f60b59a2-c955-483f-9d64-aaa791089c53" released by "_copy_volume_from_snapshot" :: held 13.458s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-656b1d73-da29-4299-be50-3057aef7b5d5-f60b59a2-c955-483f-9d64-aaa791089c53" released by "_create_volume_from_snapshot" :: held 13.555s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.578s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=597d62c6-63d0-4f67-8685-37a0e3b67002,created_at=2026-09-15T16:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1982139922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=597d62c6-63d0-4f67-8685-37a0e3b67002,host='devstack@QuobyteHD#QuobyteHD',id=830c1599-9108-4f50-98cb-babe623b03cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc518df89b944addb41ec5bb502283db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:54:50Z,use_quota=True,user_id='8b511951b79a431194a9f9c96eba8c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0bab2bc4-3188-4472-a941-2c5ca9ff653e),volume_type_id=0bab2bc4-3188-4472-a941-2c5ca9ff653e)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Creating volume 830c1599-9108-4f50-98cb-babe623b03cc {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:54:51 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:51 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc 1073741824 Sep 15 18:54:51 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e7f9566-a416-42e6-8793-ea6f04da02ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f60b59a2-c955-483f-9d64-aaa791089c53', 'volume_size': 1, 'snapshot_id': '656b1d73-da29-4299-be50-3057aef7b5d5'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc6bded-0ccf-4cf4-acc2-9a2ca32420a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Volume volume-f60b59a2-c955-483f-9d64-aaa791089c53 (f60b59a2-c955-483f-9d64-aaa791089c53): created successfully Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc6bded-0ccf-4cf4-acc2-9a2ca32420a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Flow 'volume_create_manager' (fe36e4e7-2ef3-4efb-8dc0-52f6c06c93ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f4e7bc92-69c2-4909-9463-cb463614a414 tempest-VolumesDeleteCascade-923889925 None] Created volume successfully. Sep 15 18:54:52 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc 1073741824" returned: 0 in 0.531s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:52 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc Sep 15 18:54:52 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:52 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc" returned: 0 in 0.300s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f15057e-4b11-4809-8f59-a2c1ec9522f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830c1599-9108-4f50-98cb-babe623b03cc', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f5486b-faaa-43b6-88df-8e0fd2c4f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:54:52 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Volume volume-830c1599-9108-4f50-98cb-babe623b03cc (830c1599-9108-4f50-98cb-babe623b03cc): created successfully Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23f5486b-faaa-43b6-88df-8e0fd2c4f605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Flow 'volume_create_manager' (ebadf925-95c5-4b89-bd26-ba4b17694280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:54:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-5993bb95-5345-4d58-812d-a863e3667550 tempest-GroupsTest-1624623696 None] Created volume successfully. Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-e3a25c20-107d-41db-b3ed-d616a347bf0c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-e3a25c20-107d-41db-b3ed-d616a347bf0c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Performing cascade delete. {{(pid=86137) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-656b1d73-da29-4299-be50-3057aef7b5d5-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-656b1d73-da29-4299-be50-3057aef7b5d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-e3a25c20-107d-41db-b3ed-d616a347bf0c" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-e3a25c20-107d-41db-b3ed-d616a347bf0c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-656b1d73-da29-4299-be50-3057aef7b5d5" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-656b1d73-da29-4299-be50-3057aef7b5d5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Deleting offline snapshot 656b1d73-da29-4299-be50-3057aef7b5d5 of volume e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] snapshot_file for this snap is: volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d8c5e6-7f65-462d-b49f-71c76a3f21ef]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:53 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 Sep 15 18:54:53 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:53 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5" returned: 0 in 0.539s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3a25c20-107d-41db-b3ed-d616a347bf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba80408d-1dd9-45e9-b665-3f0cd3bc3f87]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Acquiring lock "cinder-quobyte-830c1599-9108-4f50-98cb-babe623b03cc" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:53 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c Sep 15 18:54:53 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Lock "cinder-quobyte-830c1599-9108-4f50-98cb-babe623b03cc" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aba9694-096c-4355-83ef-ade5c2b38a66]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:54 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc Sep 15 18:54:54 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:54 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:54 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc" returned: 0 in 0.525s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c" returned: 0 in 0.765s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:54 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc Sep 15 18:54:54 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:54 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 Sep 15 18:54:54 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:54 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-830c1599-9108-4f50-98cb-babe623b03cc" returned: 0 in 0.327s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Lock "cinder-quobyte-830c1599-9108-4f50-98cb-babe623b03cc" released by "delete_volume" :: held 0.928s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:54 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Created reservations ['e597c5e2-dcaa-4422-a676-14df487e397d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:54 devstack cinder-volume[86137]: WARNING cinder.quota [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1798944561 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1798944561, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:54:54 devstack cinder-volume[86137]: WARNING cinder.quota [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1798944561 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1798944561, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:54:54 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Created reservations ['c48274b3-8607-4f86-9515-b3a36f4b26a8', 'b5eac65c-96bb-4854-ae5e-24a918e19de3', '218d0d52-e0c9-4d16-82cb-7bfbb2bc84b1', 'a9fed301-228d-4658-b42d-a7c510e723a9'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:54 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5" returned: 0 in 0.576s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:55 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5 Sep 15 18:54:55 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:55 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:55 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:55 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c.656b1d73-da29-4299-be50-3057aef7b5d5" returned: 0 in 0.334s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-656b1d73-da29-4299-be50-3057aef7b5d5" released by "_delete_snapshot" :: held 2.378s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-e3a25c20-107d-41db-b3ed-d616a347bf0c" released by "delete_snapshot" :: held 2.418s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:55 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.381s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1d5d3039-9792-46bd-87f6-472579490de0 tempest-GroupsTest-1624623696 None] Delete group completed successfully. Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Created reservations ['fe1f39a9-04a8-4ba0-8881-25512e50745b', '4a3ffd36-055b-4471-bfc6-cfe52e566c19', '97c6d0a9-4498-4c18-8d1c-6aaa304ae77e', 'ed74e8f3-52e5-4f48-9854-73c1eda00523'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Delete snapshot completed successfully. Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-656b1d73-da29-4299-be50-3057aef7b5d5-delete_snapshot" released by "delete_snapshot" :: held 2.670s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Snapshots deleted, issuing volume delete {{(pid=86137) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-e3a25c20-107d-41db-b3ed-d616a347bf0c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-e3a25c20-107d-41db-b3ed-d616a347bf0c" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbb8ce8-7b5d-406f-801e-b09baf5b59bd]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:55 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c Sep 15 18:54:55 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:56 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c" returned: 0 in 0.509s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:56 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c Sep 15 18:54:56 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] Created reservations ['366a1c57-0891-4cba-b5df-b1625554f306'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:56 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e3a25c20-107d-41db-b3ed-d616a347bf0c" returned: 0 in 0.355s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-e3a25c20-107d-41db-b3ed-d616a347bf0c" released by "delete_volume" :: held 0.943s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:56 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:56 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Created reservations ['f75ef2b9-4389-498b-9c24-cd4fb094c540', 'f1d9e51b-a7da-4ab7-8097-64bb0c79612d', 'fe65647f-4991-4ee9-b33d-0cb38f9fedd0', '4207a9b5-f44f-46c8-b1d4-5c6e33079146'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:56 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:56 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:56 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.368s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:56 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:56 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ce85a113-9413-4621-8745-006a095c3794 tempest-GroupsTest-1624623696 None] Delete group completed successfully. Sep 15 18:54:57 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.284s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:57 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:57 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Deleted volume successfully. Sep 15 18:54:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f75f8e9-26e4-4211-b496-91003587120a tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-e3a25c20-107d-41db-b3ed-d616a347bf0c-delete_volume" released by "delete_volume" :: held 4.226s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-f60b59a2-c955-483f-9d64-aaa791089c53-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-f60b59a2-c955-483f-9d64-aaa791089c53-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "cinder-quobyte-f60b59a2-c955-483f-9d64-aaa791089c53" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:54:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-f60b59a2-c955-483f-9d64-aaa791089c53" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:54:57 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec592f6b-2f8f-4b93-840e-0cb692103965]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:54:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:58 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 Sep 15 18:54:58 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:58 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-03d20a05-f228-48ce-947a-96b53f50d84d tempest-GroupsTest-1624623696 None] Group tempest-GroupsTest-Group-129000709: creating Sep 15 18:54:58 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-03d20a05-f228-48ce-947a-96b53f50d84d tempest-GroupsTest-1624623696 None] Group tempest-GroupsTest-Group-129000709: created successfully Sep 15 18:54:58 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-03d20a05-f228-48ce-947a-96b53f50d84d tempest-GroupsTest-1624623696 None] Create group completed successfully. Sep 15 18:54:58 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53" returned: 0 in 0.570s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:58 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53 Sep 15 18:54:58 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:58 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f60b59a2-c955-483f-9d64-aaa791089c53" returned: 0 in 0.290s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-quobyte-f60b59a2-c955-483f-9d64-aaa791089c53" released by "delete_volume" :: held 0.924s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Created reservations ['95a59567-4a05-4037-9ab2-6b8416154b0a', '9ba7275a-8e9b-4605-b2da-9cf3e2127bef', '723b078b-df53-482c-9bbb-b3584cfd7adc', '7b6d5eed-5d40-4f62-9876-10c709ced9e3'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:54:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:54:58 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:54:58 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:54:59 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 15 18:54:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.357s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:54:59 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:54:59 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Deleted volume successfully. Sep 15 18:54:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0c41ca3f-958c-4f27-92e3-b5f72862cecd tempest-VolumesDeleteCascade-923889925 None] Lock "cinder-f60b59a2-c955-483f-9d64-aaa791089c53-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Flow 'volume_create_manager' (2edf5c8b-d23d-4ed8-aca7-7d1a5be2cdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c453adab-90e4-4659-9c51-46c9d581efad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c453adab-90e4-4659-9c51-46c9d581efad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-898483144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0df6aae8-885e-4ac2-8226-8ab8f6f6bd7a,host='devstack@QuobyteHD#QuobyteHD',id=add46214-aa59-4747-8fbf-686541bd7f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc518df89b944addb41ec5bb502283db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:00Z,use_quota=True,user_id='8b511951b79a431194a9f9c96eba8c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(950510ab-2db6-4243-b388-7435e4462dc6),volume_type_id=950510ab-2db6-4243-b388-7435e4462dc6)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ceb520a-f5ab-4a6e-9ade-8aa093e525a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ceb520a-f5ab-4a6e-9ade-8aa093e525a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28554707-25bf-4e93-ada5-3a10d2c273b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28554707-25bf-4e93-ada5-3a10d2c273b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add46214-aa59-4747-8fbf-686541bd7f74', 'volume_name': 'volume-add46214-aa59-4747-8fbf-686541bd7f74', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daba847d-11be-48b9-b57b-6d27f444336f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daba847d-11be-48b9-b57b-6d27f444336f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d515c5c-bb92-40cd-b0c2-6b9a9cf278c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:00 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Volume add46214-aa59-4747-8fbf-686541bd7f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add46214-aa59-4747-8fbf-686541bd7f74', 'volume_size': 1} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0df6aae8-885e-4ac2-8226-8ab8f6f6bd7a,created_at=2026-09-15T16:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-898483144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0df6aae8-885e-4ac2-8226-8ab8f6f6bd7a,host='devstack@QuobyteHD#QuobyteHD',id=add46214-aa59-4747-8fbf-686541bd7f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc518df89b944addb41ec5bb502283db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:00Z,use_quota=True,user_id='8b511951b79a431194a9f9c96eba8c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(950510ab-2db6-4243-b388-7435e4462dc6),volume_type_id=950510ab-2db6-4243-b388-7435e4462dc6)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Creating volume add46214-aa59-4747-8fbf-686541bd7f74 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:55:00 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:55:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:00 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74 1073741824 Sep 15 18:55:00 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:01 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74 1073741824" returned: 0 in 0.882s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:01 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=147,cinder:INSERT=52,cinder:UPDATE=174,cinder:DELETE=14 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:55:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:01 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74 Sep 15 18:55:01 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:02 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74" returned: 0 in 0.400s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:55:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d515c5c-bb92-40cd-b0c2-6b9a9cf278c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add46214-aa59-4747-8fbf-686541bd7f74', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17017d6c-8692-4a4c-b63a-2358ffb267f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:02 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Volume volume-add46214-aa59-4747-8fbf-686541bd7f74 (add46214-aa59-4747-8fbf-686541bd7f74): created successfully Sep 15 18:55:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17017d6c-8692-4a4c-b63a-2358ffb267f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Flow 'volume_create_manager' (2edf5c8b-d23d-4ed8-aca7-7d1a5be2cdbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3e04f8a2-c2dd-4ee7-a8a1-d9319aa33600 tempest-GroupsTest-1624623696 None] Created volume successfully. Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=160,cinder:INSERT=36,cinder:UPDATE=163,cinder:DELETE=8 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Flow 'volume_create_manager' (6ed12cca-02f8-4a12-a1a9-8692c2930249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55af9230-f021-4e59-9cb9-e8c01099b5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55af9230-f021-4e59-9cb9-e8c01099b5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-166882126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0df6aae8-885e-4ac2-8226-8ab8f6f6bd7a,host='devstack@QuobyteHD#QuobyteHD',id=984f9019-dc86-4659-b896-26dc10df7379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc518df89b944addb41ec5bb502283db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:04Z,use_quota=True,user_id='8b511951b79a431194a9f9c96eba8c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(950510ab-2db6-4243-b388-7435e4462dc6),volume_type_id=950510ab-2db6-4243-b388-7435e4462dc6)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb7bcb3-95dd-44c4-aa75-2a1a33c505a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb7bcb3-95dd-44c4-aa75-2a1a33c505a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4c53b6-7940-4ece-8071-319878ab18ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4c53b6-7940-4ece-8071-319878ab18ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984f9019-dc86-4659-b896-26dc10df7379', 'volume_name': 'volume-984f9019-dc86-4659-b896-26dc10df7379', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6f22f8-6943-40ff-b54e-5a68f31dff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f6f22f8-6943-40ff-b54e-5a68f31dff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c225e99-1584-4e2b-9e76-494f77fa3909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Volume 984f9019-dc86-4659-b896-26dc10df7379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984f9019-dc86-4659-b896-26dc10df7379', 'volume_size': 1} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0df6aae8-885e-4ac2-8226-8ab8f6f6bd7a,created_at=2026-09-15T16:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-166882126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0df6aae8-885e-4ac2-8226-8ab8f6f6bd7a,host='devstack@QuobyteHD#QuobyteHD',id=984f9019-dc86-4659-b896-26dc10df7379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc518df89b944addb41ec5bb502283db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:04Z,use_quota=True,user_id='8b511951b79a431194a9f9c96eba8c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(950510ab-2db6-4243-b388-7435e4462dc6),volume_type_id=950510ab-2db6-4243-b388-7435e4462dc6)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Creating volume 984f9019-dc86-4659-b896-26dc10df7379 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:55:03 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:55:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:04 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379 1073741824 Sep 15 18:55:04 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:04 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379 1073741824" returned: 0 in 0.648s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:04 devstack sudo[99467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379 Sep 15 18:55:04 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Flow 'volume_create_manager' (b0742ff2-ec0a-4cfa-8046-2acba91d3f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49f3366-f22f-4302-894c-c1229ee97426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49f3366-f22f-4302-894c-c1229ee97426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1302232890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7318f65-802d-49a0-a513-046f0de5834f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b689cc3bef46699662e9d4c74f30c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:05Z,use_quota=True,user_id='930012a8fa9d4e0c93aab82e94663765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a884a8-ef72-4e7c-88b8-ba3b9d0816ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a884a8-ef72-4e7c-88b8-ba3b9d0816ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7003c1-d5fe-460e-83f4-ba938ed79f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7003c1-d5fe-460e-83f4-ba938ed79f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7318f65-802d-49a0-a513-046f0de5834f', 'volume_name': 'volume-c7318f65-802d-49a0-a513-046f0de5834f', 'volume_size': 2}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52b9de0-afdb-450d-bb9b-e3ee26eb9759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52b9de0-afdb-450d-bb9b-e3ee26eb9759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519f233c-3143-420f-97f2-a79f65fb8270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Volume c7318f65-802d-49a0-a513-046f0de5834f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7318f65-802d-49a0-a513-046f0de5834f', 'volume_size': 2} Sep 15 18:55:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:05 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379" returned: 0 in 0.353s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1302232890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7318f65-802d-49a0-a513-046f0de5834f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9b689cc3bef46699662e9d4c74f30c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:05Z,use_quota=True,user_id='930012a8fa9d4e0c93aab82e94663765',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Creating volume c7318f65-802d-49a0-a513-046f0de5834f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:55:05 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f 2147483648 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c225e99-1584-4e2b-9e76-494f77fa3909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984f9019-dc86-4659-b896-26dc10df7379', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:05 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f 2147483648 Sep 15 18:55:05 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b626b8b-de12-41b6-a960-2f908914ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:05 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Volume volume-984f9019-dc86-4659-b896-26dc10df7379 (984f9019-dc86-4659-b896-26dc10df7379): created successfully Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b626b8b-de12-41b6-a960-2f908914ba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Flow 'volume_create_manager' (6ed12cca-02f8-4a12-a1a9-8692c2930249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-606a8d4c-ae49-43d2-9c8f-5eac648c927f tempest-GroupsTest-1624623696 None] Created volume successfully. Sep 15 18:55:05 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f 2147483648" returned: 0 in 0.737s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:05 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f Sep 15 18:55:05 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:06 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f" returned: 0 in 0.281s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:55:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519f233c-3143-420f-97f2-a79f65fb8270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7318f65-802d-49a0-a513-046f0de5834f', 'volume_size': 2}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a8b2e8-78ea-4d9c-8f79-25f2097a9072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:06 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Volume volume-c7318f65-802d-49a0-a513-046f0de5834f (c7318f65-802d-49a0-a513-046f0de5834f): created successfully Sep 15 18:55:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a8b2e8-78ea-4d9c-8f79-25f2097a9072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Flow 'volume_create_manager' (b0742ff2-ec0a-4cfa-8046-2acba91d3f30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ed6bdb1c-4178-4ba8-b3ce-eb4eef18e17d tempest-VolumesCloneNegativeTest-359096608 None] Created volume successfully. Sep 15 18:55:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8fd39d3f-5ea1-4521-a40b-1130ebd2c305 tempest-GroupsTest-1624623696 None] Update group completed successfully. Sep 15 18:55:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Acquiring lock "cinder-c7318f65-802d-49a0-a513-046f0de5834f-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Lock "cinder-c7318f65-802d-49a0-a513-046f0de5834f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Acquiring lock "cinder-quobyte-c7318f65-802d-49a0-a513-046f0de5834f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Lock "cinder-quobyte-c7318f65-802d-49a0-a513-046f0de5834f" acquired by "delete_volume" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:07 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[24725e87-7a0b-4180-b96d-7e635b13b0dc]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:07 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f Sep 15 18:55:07 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:07 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f" returned: 0 in 0.405s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:07 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f Sep 15 18:55:07 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:07 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c7318f65-802d-49a0-a513-046f0de5834f" returned: 0 in 0.357s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Lock "cinder-quobyte-c7318f65-802d-49a0-a513-046f0de5834f" released by "delete_volume" :: held 0.813s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-870168d6-81cf-473f-a07b-0e7c97595658 tempest-GroupsTest-1624623696 None] Update group completed successfully. Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Created reservations ['4bf4974c-f73e-465e-b484-6bcd7d473957', '5c1849d6-eb80-4733-a6e7-53183d1babf2', '8efe5fef-acb5-4638-afde-c9b602654e6a', '3df71abf-ced6-46cf-bac7-390ed5c6c082'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:08 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:55:08 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:08 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.346s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:55:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Deleted volume successfully. Sep 15 18:55:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e5548bf-aaa9-41f2-8887-bd3dd0e0536e tempest-VolumesCloneNegativeTest-359096608 None] Lock "cinder-c7318f65-802d-49a0-a513-046f0de5834f-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Acquiring lock "cinder-quobyte-984f9019-dc86-4659-b896-26dc10df7379" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Lock "cinder-quobyte-984f9019-dc86-4659-b896-26dc10df7379" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:09 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b3afde-19cb-4fc7-909b-dcdb81ce06b7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:10 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379 Sep 15 18:55:10 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:10 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379" returned: 0 in 0.456s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:10 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379 Sep 15 18:55:10 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:10 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-984f9019-dc86-4659-b896-26dc10df7379" returned: 0 in 0.288s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Lock "cinder-quobyte-984f9019-dc86-4659-b896-26dc10df7379" released by "delete_volume" :: held 0.814s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Acquiring lock "cinder-quobyte-add46214-aa59-4747-8fbf-686541bd7f74" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Lock "cinder-quobyte-add46214-aa59-4747-8fbf-686541bd7f74" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:10 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b191ed-450b-4333-bd6a-b73e0d954323]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:10 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74 Sep 15 18:55:10 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:11 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74" returned: 0 in 0.450s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:11 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74 Sep 15 18:55:11 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:11 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-add46214-aa59-4747-8fbf-686541bd7f74" returned: 0 in 0.319s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Lock "cinder-quobyte-add46214-aa59-4747-8fbf-686541bd7f74" released by "delete_volume" :: held 0.829s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:11 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Created reservations ['8d801a41-6095-48f0-bd44-463e15b53ecf'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:55:11 devstack cinder-volume[86137]: WARNING cinder.quota [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1988254201 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1988254201, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:55:11 devstack cinder-volume[86137]: WARNING cinder.quota [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1988254201 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1988254201, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:55:11 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Created reservations ['c49e6359-6688-4114-876a-74c92ed26885', '095d1859-4e7f-4fb4-a5ef-c72e92849dd6', '05bcabc5-449d-4449-96b3-ac2f95c94399', 'e91f8e2a-c12a-4833-ac9e-352bb0b9b230'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:55:11 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Created reservations ['730245bf-e695-447e-8c47-06af07a7b633', '863be140-1a24-4df6-860b-79c252a62eda', 'da41123b-7962-4ec9-82bd-7fb1c347727a', 'd59fab51-4a03-4182-ab5c-4f6e2574d7d9'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:55:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:55:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:55:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:12 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:55:12 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:12 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.348s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:12 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:55:12 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-30c8e978-2ec0-4ecf-b0b2-c4a028bf7a30 tempest-GroupsTest-1624623696 None] Delete group completed successfully. Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Flow 'volume_create_manager' (0b76712b-61ee-4bbb-a3b8-5bd60977480d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fa9af7-12c2-4322-9187-1b2ed1ac30fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fa9af7-12c2-4322-9187-1b2ed1ac30fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-248777876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d388d1-a822-4b02-a4fa-8fee77e8de40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d4299f6eaa4823bd3050e25912ff11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:24Z,use_quota=True,user_id='1b3000481dcf436ab1c9127af33b5955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412a3b12-a73a-4c53-90a5-0d1f52128443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (412a3b12-a73a-4c53-90a5-0d1f52128443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce127b88-c68f-4b82-a292-64c8e2711cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce127b88-c68f-4b82-a292-64c8e2711cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d388d1-a822-4b02-a4fa-8fee77e8de40', 'volume_name': 'volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a30545f-bccf-4264-9e49-8419bf5bb3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a30545f-bccf-4264-9e49-8419bf5bb3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57797c82-019c-49de-a7ba-5c15094d00e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:24 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Volume c4d388d1-a822-4b02-a4fa-8fee77e8de40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40', 'volume_size': 1} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-248777876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d388d1-a822-4b02-a4fa-8fee77e8de40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92d4299f6eaa4823bd3050e25912ff11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:24Z,use_quota=True,user_id='1b3000481dcf436ab1c9127af33b5955',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Creating volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:55:24 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:55:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:24 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 1073741824 Sep 15 18:55:24 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:24 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 1073741824" returned: 0 in 0.572s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:25 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 Sep 15 18:55:25 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:25 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40" returned: 0 in 0.274s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:55:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57797c82-019c-49de-a7ba-5c15094d00e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8755afb7-ac5f-4071-8ef8-219fe52d3484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:25 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Volume volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 (c4d388d1-a822-4b02-a4fa-8fee77e8de40): created successfully Sep 15 18:55:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8755afb7-ac5f-4071-8ef8-219fe52d3484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Flow 'volume_create_manager' (0b76712b-61ee-4bbb-a3b8-5bd60977480d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6ced290d-3dba-43d4-9f97-34407a67c159 tempest-SnapshotsActionsTest-1434127118 None] Created volume successfully. Sep 15 18:55:26 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-5a4b633e-8086-4057-bf5c-099625150c9a tempest-TestShelveInstance-1320791387 None] Terminate volume connection completed successfully. Sep 15 18:55:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-5a4b633e-8086-4057-bf5c-099625150c9a tempest-TestShelveInstance-1320791387 None] Deleting attachment 51d0df88-5dbf-448e-942e-f45645a783ea. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:55:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Acquiring lock "cinder-047cb9b7-6c34-4c8e-acf0-461eb08c3b25-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Lock "cinder-047cb9b7-6c34-4c8e-acf0-461eb08c3b25-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Acquiring lock "cinder-quobyte-047cb9b7-6c34-4c8e-acf0-461eb08c3b25" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Lock "cinder-quobyte-047cb9b7-6c34-4c8e-acf0-461eb08c3b25" acquired by "delete_volume" :: waited 0.033s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1f40d0-c5a2-4b9b-8e67-011b432216be]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:26 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 Sep 15 18:55:27 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Creating offline snapshot ac06d90e-d960-44ff-88b5-10085e611766 of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a41e69-71f3-4a3a-97a8-c5e0c93015b5]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:27 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 Sep 15 18:55:27 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:27 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25" returned: 0 in 0.661s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:27 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25 Sep 15 18:55:27 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:27 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40" returned: 0 in 0.681s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:27 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 1G Sep 15 18:55:27 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:27 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-047cb9b7-6c34-4c8e-acf0-461eb08c3b25" returned: 0 in 0.480s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Lock "cinder-quobyte-047cb9b7-6c34-4c8e-acf0-461eb08c3b25" released by "delete_volume" :: held 1.238s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:27 devstack cinder-volume[86137]: DEBUG cinder.quota [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Created reservations ['a1ab2e48-7fc4-49d3-834f-20215c2ee91a', '7cf4e838-7923-4d83-9212-7e2cb2b6ad63', '4654224e-5793-44f7-adfa-f9c046959340', '3c5aa685-e9b1-4951-8916-65a6331bec76'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:28 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:55:28 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:28 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 1G" returned: 0 in 0.636s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:28 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG cinder.manager [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:55:28 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:55:28 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Deleted volume successfully. Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [req-7c5ea9d9-019c-45b4-a130-a458072645d7 req-88d66e36-b542-4fc6-b248-73646fce0cc0 tempest-TestShelveInstance-1320791387 None] Lock "cinder-047cb9b7-6c34-4c8e-acf0-461eb08c3b25-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:28 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.474s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:28 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 is being set with open permissions: ugo+rw Sep 15 18:55:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:28 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:55:28 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:29 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.387s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:29 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.info Sep 15 18:55:29 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:29 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.info" returned: 0 in 0.433s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:29 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.info is being set with open permissions: ugo+rw Sep 15 18:55:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:29 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.info Sep 15 18:55:29 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:30 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.info" returned: 0 in 0.365s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.145s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:30 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-477a2185-abb7-4146-9a9d-8c7365468f5a tempest-SnapshotsActionsTest-1434127118 None] Create snapshot completed successfully Sep 15 18:55:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Creating offline snapshot 2161dc0c-31a2-46e8-be3a-693b5a6dc595 of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:55:31 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[763c4ab2-edcd-428b-ad8f-6ba1a2a4f880]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:32 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:55:32 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:32 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.468s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:55:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:32 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 1G Sep 15 18:55:32 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:32 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 1G" returned: 0 in 0.490s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:32 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 Sep 15 18:55:32 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:33 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595" returned: 0 in 0.413s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:33 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 is being set with open permissions: ugo+rw Sep 15 18:55:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:33 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 Sep 15 18:55:33 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:33 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595" returned: 0 in 0.424s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7e1da7cc-40c3-4619-9136-ee5af41e68d9 tempest-SnapshotsActionsTest-1434127118 None] Create snapshot completed successfully Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-2161dc0c-31a2-46e8-be3a-693b5a6dc595-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-2161dc0c-31a2-46e8-be3a-693b5a6dc595-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-quobyte-2161dc0c-31a2-46e8-be3a-693b5a6dc595" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-2161dc0c-31a2-46e8-be3a-693b5a6dc595" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Deleting offline snapshot 2161dc0c-31a2-46e8-be3a-693b5a6dc595 of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] snapshot_file for this snap is: volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e009b06-7a8c-46f8-9997-c6cf7fd2f40f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:34 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 Sep 15 18:55:34 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:34 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595" returned: 0 in 0.438s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f16a78b-77cc-4b25-b0c3-7cf645a9bae4]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:34 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:55:34 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:35 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.416s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:55:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:35 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 Sep 15 18:55:35 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:35 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595" returned: 0 in 0.446s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:35 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595 Sep 15 18:55:35 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:35 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.2161dc0c-31a2-46e8-be3a-693b5a6dc595" returned: 0 in 0.330s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-2161dc0c-31a2-46e8-be3a-693b5a6dc595" released by "_delete_snapshot" :: held 1.799s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" released by "delete_snapshot" :: held 1.828s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:36 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Created reservations ['b8f8473e-d974-4e22-99d5-9e317cd63c16', 'b2cffe05-046d-487c-a56b-84244005ae82', '147caea2-3fff-43dd-b122-d5b0d884127b', '3b528c55-1c9a-4c9e-a4e7-519bccd0148f'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:55:36 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Delete snapshot completed successfully. Sep 15 18:55:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a42aa884-1504-4c51-a68f-fe60d206d502 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-2161dc0c-31a2-46e8-be3a-693b5a6dc595-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Creating offline snapshot f4a61638-451f-4ff1-87d7-63cf32dca9ef of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:55:36 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac0bc66-aa2e-4659-9c96-611acd5593ff]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:36 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:55:36 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:37 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.426s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:55:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:37 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef 1G Sep 15 18:55:37 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:37 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef 1G" returned: 0 in 0.572s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:37 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef Sep 15 18:55:37 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:38 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef" returned: 0 in 0.316s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:38 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef is being set with open permissions: ugo+rw Sep 15 18:55:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:38 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef Sep 15 18:55:38 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:38 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef" returned: 0 in 0.277s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.771s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-eff88ac9-8113-4f48-93fe-d183304d3731 tempest-SnapshotsActionsTest-1434127118 None] Create snapshot completed successfully Sep 15 18:55:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-f4a61638-451f-4ff1-87d7-63cf32dca9ef-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-f4a61638-451f-4ff1-87d7-63cf32dca9ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-quobyte-f4a61638-451f-4ff1-87d7-63cf32dca9ef" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-f4a61638-451f-4ff1-87d7-63cf32dca9ef" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Deleting offline snapshot f4a61638-451f-4ff1-87d7-63cf32dca9ef of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] snapshot_file for this snap is: volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ad95e7-fb35-4ab7-b642-61dff63f435b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:39 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef Sep 15 18:55:39 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:39 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef" returned: 0 in 0.445s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fe5a4d-8949-42b8-addd-3363cb6f32bb]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:39 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:55:39 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:40 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.439s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:40 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef Sep 15 18:55:40 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:40 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef" returned: 0 in 0.396s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:40 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef Sep 15 18:55:40 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:40 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.f4a61638-451f-4ff1-87d7-63cf32dca9ef" returned: 0 in 0.269s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-f4a61638-451f-4ff1-87d7-63cf32dca9ef" released by "_delete_snapshot" :: held 1.683s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" released by "delete_snapshot" :: held 1.710s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Created reservations ['f16d3874-708a-4e97-87fa-b9ecf685f446', 'e1d31589-1fb9-46c3-aa93-cc7474771897', '4f3b69d6-675e-474b-ba14-355a7bcd9818', '04c60218-6f1b-4ded-b231-4891b3a1d5da'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:55:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Delete snapshot completed successfully. Sep 15 18:55:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cc9d1294-26a0-4a6a-999c-97872ede117f tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-f4a61638-451f-4ff1-87d7-63cf32dca9ef-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Creating offline snapshot e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:55:41 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92f5faa-0c6e-446a-b9af-3310dfc24d27]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:41 devstack sudo[99821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:55:41 devstack sudo[99821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:42 devstack sudo[99821]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.649s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:55:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:42 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af 1G Sep 15 18:55:42 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:43 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af 1G" returned: 0 in 0.960s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:43 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af Sep 15 18:55:43 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:43 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af" returned: 0 in 0.595s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:43 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af is being set with open permissions: ugo+rw Sep 15 18:55:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:44 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af Sep 15 18:55:44 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Flow 'volume_create_manager' (5648a249-460c-4f89-b7da-24f857d11c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5869a6db-6a9f-4349-9210-2fdb08c883fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5869a6db-6a9f-4349-9210-2fdb08c883fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-366493994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f743d33e-d748-4661-b9f7-d657d96e2984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0cbbb5872ff45bc82c8e213158f2a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:44Z,use_quota=True,user_id='59da0551716344aaba539e1002222ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d02f28-ad3d-4ff6-9cd8-c7643b69c197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d02f28-ad3d-4ff6-9cd8-c7643b69c197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab5b1bc-03bb-4b29-83c3-19ded3b7b60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab5b1bc-03bb-4b29-83c3-19ded3b7b60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f743d33e-d748-4661-b9f7-d657d96e2984', 'volume_name': 'volume-f743d33e-d748-4661-b9f7-d657d96e2984', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d87ce50-6b13-439f-8627-1363162e8993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d87ce50-6b13-439f-8627-1363162e8993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7dcce7-213b-460f-b09b-8c37cf773ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:44 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Volume f743d33e-d748-4661-b9f7-d657d96e2984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f743d33e-d748-4661-b9f7-d657d96e2984', 'volume_size': 1} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:44 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af" returned: 0 in 0.421s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.774s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-366493994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f743d33e-d748-4661-b9f7-d657d96e2984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0cbbb5872ff45bc82c8e213158f2a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:44Z,use_quota=True,user_id='59da0551716344aaba539e1002222ca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Creating volume f743d33e-d748-4661-b9f7-d657d96e2984 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:55:44 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:55:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:44 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 1073741824 Sep 15 18:55:44 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:44 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-2b91c498-aae7-4cd6-8b2f-e1c569d7562e tempest-SnapshotsActionsTest-1434127118 None] Create snapshot completed successfully Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-quobyte-e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Deleting offline snapshot e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] snapshot_file for this snap is: volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0176ed90-cbc4-44ef-b016-1f0e29e12eb5]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:45 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af Sep 15 18:55:45 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:45 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 1073741824" returned: 0 in 0.898s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:45 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 Sep 15 18:55:45 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:45 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af" returned: 0 in 0.551s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:45 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ba90b4-0f54-45f9-a889-51399edca416]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984" returned: 0 in 0.453s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:55:45 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:55:45 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7dcce7-213b-460f-b09b-8c37cf773ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f743d33e-d748-4661-b9f7-d657d96e2984', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38279fe-f23b-4364-ace8-0e287e02fa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:45 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Volume volume-f743d33e-d748-4661-b9f7-d657d96e2984 (f743d33e-d748-4661-b9f7-d657d96e2984): created successfully Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d38279fe-f23b-4364-ace8-0e287e02fa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Flow 'volume_create_manager' (5648a249-460c-4f89-b7da-24f857d11c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-2651cd23-124e-443e-af60-962d0cd414ca tempest-TestImageHashVerification-201201982 None] Created volume successfully. Sep 15 18:55:46 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:55:46 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:46 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.529s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:55:46 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.840s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:55:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:46 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af Sep 15 18:55:46 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:47 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af" returned: 0 in 0.645s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:47 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af Sep 15 18:55:47 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:47 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af" returned: 0 in 0.521s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af" released by "_delete_snapshot" :: held 2.819s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" released by "delete_snapshot" :: held 2.875s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:48 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Created reservations ['cd78345b-56f2-48c1-9b86-03f7cd25f8ae', '351a03d8-2f44-40d1-803b-a61f25b00ed0', 'e8a93b7f-0825-41d0-b994-ddd18c1e3a84', '6c3f1d05-4ef1-4fa0-b878-f0242e805c1b'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:55:48 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Delete snapshot completed successfully. Sep 15 18:55:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5b6ea757-8117-4d1a-88f5-366988e56a15 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-e6d8a4ae-fb31-43c4-bddf-cf0a9885b8af-delete_snapshot" released by "delete_snapshot" :: held 3.099s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:55:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:55:48 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[250b5ca7-f8ad-4dfc-98b6-5e47a7553af2]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (ad2f6c0b-d48a-4a6e-b166-bb6e3d7fcb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf07a9c-fcba-42fd-b515-6e2ffaa11d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:49 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 Sep 15 18:55:49 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaf07a9c-fcba-42fd-b515-6e2ffaa11d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1370882202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:49Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb525ce-03e8-4e45-84ca-2a119c8ff005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb525ce-03e8-4e45-84ca-2a119c8ff005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966f408e-505e-4c2a-9504-f970ae141061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (966f408e-505e-4c2a-9504-f970ae141061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e', 'volume_name': 'volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca2d67a-18e1-4335-b5f1-41f848fdc0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca2d67a-18e1-4335-b5f1-41f848fdc0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad94608-407b-4adc-9746-991d834aeb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:55:49 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume 59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e', 'volume_size': 1} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:55:49 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984" returned: 0 in 0.479s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d15683-8c9f-4c72-af0e-afd4d58e3355]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:49 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 Sep 15 18:55:49 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:49 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984" returned: 0 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 /opt/stack/data/cinder/conversion/f743d33e-d748-4661-b9f7-d657d96e2984.temp_image.30239f94-5820-48de-ad71-e9272acd9856rgen789n.img {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:49 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 /opt/stack/data/cinder/conversion/f743d33e-d748-4661-b9f7-d657d96e2984.temp_image.30239f94-5820-48de-ad71-e9272acd9856rgen789n.img Sep 15 18:55:49 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:57 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 /opt/stack/data/cinder/conversion/f743d33e-d748-4661-b9f7-d657d96e2984.temp_image.30239f94-5820-48de-ad71-e9272acd9856rgen789n.img" returned: 0 in 7.338s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:57 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e41345d-31d8-4ccc-b5c1-7062c7e8b434]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:55:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:55:57 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 Sep 15 18:55:57 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:55:57 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 15 18:55:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984" returned: 0 in 0.520s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:55:57 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/conversion/f743d33e-d748-4661-b9f7-d657d96e2984.temp_image.30239f94-5820-48de-ad71-e9272acd9856rgen789n.img {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:55:57 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Converted 1024.00 MB image at 139.52 MB/s Sep 15 18:55:57 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] 30239f94-5820-48de-ad71-e9272acd9856 was raw, no need to convert to raw {{(pid=86137) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 15 18:56:07 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=60,cinder:INSERT=20,cinder:UPDATE=64,cinder:DELETE=3 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:56:07 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=80,cinder:SELECT=68,cinder:DELETE=7,cinder:INSERT=14 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Flow 'volume_create_manager' (59f744d4-7b27-44cd-9918-8aceb523a629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fd9991-588b-464a-a701-df7d2eb5ec19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fd9991-588b-464a-a701-df7d2eb5ec19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1974023011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fddd249-9a52-400b-9e61-8aab534d9666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d971a731c604ded84e8a532fb3b096d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:09Z,use_quota=True,user_id='0b2142b14ee24830b0daa88a4349b5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6976cf89-5cbf-46b8-89fa-b95c3ec9bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6976cf89-5cbf-46b8-89fa-b95c3ec9bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33efcf3-e72e-4202-bc93-b7ee4f51b1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a33efcf3-e72e-4202-bc93-b7ee4f51b1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fddd249-9a52-400b-9e61-8aab534d9666', 'volume_name': 'volume-1fddd249-9a52-400b-9e61-8aab534d9666', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b28e6cf-13a0-4c8c-9e00-3717ba9c4ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b28e6cf-13a0-4c8c-9e00-3717ba9c4ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391a49b3-d3b4-45ff-8493-6924a85c415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:09 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Volume 1fddd249-9a52-400b-9e61-8aab534d9666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fddd249-9a52-400b-9e61-8aab534d9666', 'volume_size': 1} Sep 15 18:56:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.752s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Uploaded volume to glance image-id: 30239f94-5820-48de-ad71-e9272acd9856. {{(pid=86137) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.495s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1370882202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:55:49Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Creating volume 59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:16 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:16 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e 1073741824 Sep 15 18:56:16 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:16 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4af52a21-bde7-48e1-815f-c4a379285d8e tempest-TestImageHashVerification-201201982 None] Copy volume to image completed successfully. Sep 15 18:56:17 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e 1073741824" returned: 0 in 0.475s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:17 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e Sep 15 18:56:17 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:17 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e" returned: 0 in 0.271s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 28.167s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad94608-407b-4adc-9746-991d834aeb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e558f9-61da-4b15-a876-5f1a838ad800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Creating offline snapshot 3c0be773-9d28-4b29-baab-c44780f891e3 of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:56:17 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e (59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e): created successfully Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e558f9-61da-4b15-a876-5f1a838ad800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (ad2f6c0b-d48a-4a6e-b166-bb6e3d7fcb60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5198eeec-9529-4b1c-a2b0-02c40bef1ff6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Acquiring lock "cinder-f743d33e-d748-4661-b9f7-d657d96e2984-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:17 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-88e92667-0703-432b-a75f-d46844a1dff7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created volume successfully. Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Lock "cinder-f743d33e-d748-4661-b9f7-d657d96e2984-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Acquiring lock "cinder-quobyte-f743d33e-d748-4661-b9f7-d657d96e2984" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Lock "cinder-quobyte-f743d33e-d748-4661-b9f7-d657d96e2984" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:17 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:56:17 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd764a1-a2fb-4372-8aba-2e63df59fca8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:17 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 Sep 15 18:56:17 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:17 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.371s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:56:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:18 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 1G Sep 15 18:56:18 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:18 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984" returned: 0 in 0.390s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:18 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984 Sep 15 18:56:18 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:18 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f743d33e-d748-4661-b9f7-d657d96e2984" returned: 0 in 0.284s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Lock "cinder-quobyte-f743d33e-d748-4661-b9f7-d657d96e2984" released by "delete_volume" :: held 0.731s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:18 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 1G" returned: 0 in 0.509s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Created reservations ['0193882f-1e2d-4c3b-b698-78e18effcb90', 'd98a38af-75dc-466d-bdc6-760e5e256987', '9f8e3fed-0b9f-4fe8-8b39-4b1b72f06e32', '07e7b880-0e0e-481f-951c-5a6379d52fce'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:18 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 Sep 15 18:56:18 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:18 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:18 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (91282c49-27c3-4a9c-a902-259edfba7491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f8145a-a53d-4db2-9c3a-e3d1dbca1317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:18 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3" returned: 0 in 0.442s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:18 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 is being set with open permissions: ugo+rw Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f8145a-a53d-4db2-9c3a-e3d1dbca1317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111180319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980db5e2-970a-4301-8cd2-ef3538cacf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:19Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6213e2ff-5269-435c-af76-ede6d8f45883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6213e2ff-5269-435c-af76-ede6d8f45883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:18 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5391bb-a8e8-468b-bf0c-3534216df05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:18 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 Sep 15 18:56:18 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5391bb-a8e8-468b-bf0c-3534216df05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980db5e2-970a-4301-8cd2-ef3538cacf5d', 'volume_name': 'volume-980db5e2-970a-4301-8cd2-ef3538cacf5d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599dbd52-c9d5-45cf-b3d5-5e3a217193e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599dbd52-c9d5-45cf-b3d5-5e3a217193e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6a0a3e-8e39-4fc4-be69-764d6ed03c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:19 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume 980db5e2-970a-4301-8cd2-ef3538cacf5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980db5e2-970a-4301-8cd2-ef3538cacf5d', 'volume_size': 1} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.386s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:19 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Deleted volume successfully. Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd7ecd08-b15b-4a7b-beee-2c45e388cc87 tempest-TestImageHashVerification-201201982 None] Lock "cinder-f743d33e-d748-4661-b9f7-d657d96e2984-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:19 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3" returned: 0 in 0.324s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.202s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1974023011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fddd249-9a52-400b-9e61-8aab534d9666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d971a731c604ded84e8a532fb3b096d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:09Z,use_quota=True,user_id='0b2142b14ee24830b0daa88a4349b5d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Creating volume 1fddd249-9a52-400b-9e61-8aab534d9666 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:19 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:19 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666 1073741824 Sep 15 18:56:19 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (806e29e6-73d2-4c0c-a87f-ab2e9686b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c8a601-68bc-4d0d-948e-8ad4c30fd742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c8a601-68bc-4d0d-948e-8ad4c30fd742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1502495230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd7b035-9c7f-4d87-b08f-e2cf8c44d97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:19Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f49c728-2327-418e-bab5-217c597d0d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f49c728-2327-418e-bab5-217c597d0d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4026da12-a287-4c31-97cc-9341b2f4ea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4026da12-a287-4c31-97cc-9341b2f4ea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd7b035-9c7f-4d87-b08f-e2cf8c44d97d', 'volume_name': 'volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076f16b1-2034-42e3-b59d-59e773a2d9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076f16b1-2034-42e3-b59d-59e773a2d9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e647d1f-4c97-4295-b685-08c1577b8d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:19 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume abd7b035-9c7f-4d87-b08f-e2cf8c44d97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d', 'volume_size': 1} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:19 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-91eaecfc-65fe-4535-9d49-a8e2db23e0c4 tempest-SnapshotsActionsTest-1434127118 None] Create snapshot completed successfully Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-3c0be773-9d28-4b29-baab-c44780f891e3-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (f2a385d1-5abb-44ca-8ffa-1bd356f15078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8891458a-e023-44eb-9c88-9235f9955881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-3c0be773-9d28-4b29-baab-c44780f891e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8891458a-e023-44eb-9c88-9235f9955881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-261505486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68034eee-3a02-4d48-9425-24fdc095220e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:20Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d301482c-2d86-4a1b-86c0-f1523ad0c228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d301482c-2d86-4a1b-86c0-f1523ad0c228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8a04b6-f23d-4120-bdce-658a6ad2d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8a04b6-f23d-4120-bdce-658a6ad2d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68034eee-3a02-4d48-9425-24fdc095220e', 'volume_name': 'volume-68034eee-3a02-4d48-9425-24fdc095220e', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec7644d-3440-43ca-b746-5472a943178a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec7644d-3440-43ca-b746-5472a943178a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a898bc-96ac-453c-9763-b45efe448534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume 68034eee-3a02-4d48-9425-24fdc095220e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68034eee-3a02-4d48-9425-24fdc095220e', 'volume_size': 1} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" acquired by "delete_snapshot" :: waited 0.126s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Acquiring lock "cinder-quobyte-3c0be773-9d28-4b29-baab-c44780f891e3" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:20 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666 1073741824" returned: 0 in 0.784s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-3c0be773-9d28-4b29-baab-c44780f891e3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Deleting offline snapshot 3c0be773-9d28-4b29-baab-c44780f891e3 of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] snapshot_file for this snap is: volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c882be-13ff-4b1e-8aa3-85360abf7f78]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:20 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666 Sep 15 18:56:20 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:20 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 Sep 15 18:56:20 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (b433fd28-10c3-414e-b431-8925e5672e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a290cf-93f5-441d-b89f-f28d6502e5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a290cf-93f5-441d-b89f-f28d6502e5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-80487957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:20Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683dbc27-cff3-4338-8441-ac29df10cc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683dbc27-cff3-4338-8441-ac29df10cc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf1bce4-af9d-4c86-8afb-ffb98b4bfa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf1bce4-af9d-4c86-8afb-ffb98b4bfa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1', 'volume_name': 'volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c7d18b-939e-4cf9-9cdf-5d8060312f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c7d18b-939e-4cf9-9cdf-5d8060312f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40496f0-7e3c-4a29-ab6d-252c1f03e130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume 0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1', 'volume_size': 1} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:20 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666" returned: 0 in 0.363s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111180319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980db5e2-970a-4301-8cd2-ef3538cacf5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:19Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Creating volume 980db5e2-970a-4301-8cd2-ef3538cacf5d {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:20 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (391a49b3-d3b4-45ff-8493-6924a85c415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fddd249-9a52-400b-9e61-8aab534d9666', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d 1073741824 Sep 15 18:56:20 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f99d05-dd9f-42bf-9017-b94698d4bc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Volume volume-1fddd249-9a52-400b-9e61-8aab534d9666 (1fddd249-9a52-400b-9e61-8aab534d9666): created successfully Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f99d05-dd9f-42bf-9017-b94698d4bc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Flow 'volume_create_manager' (59f744d4-7b27-44cd-9918-8aceb523a629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:20 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ba99d2e5-fd47-42d0-b008-4f9bfbac4817 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Created volume successfully. Sep 15 18:56:20 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3" returned: 0 in 0.581s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (5a1ad393-f11c-4cde-8ff4-01eb14d5a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5309f04-d431-4883-8a62-5fce71bd8bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d311f641-d000-42d7-8cc6-9bb6f936e95e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5309f04-d431-4883-8a62-5fce71bd8bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744522973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fa84b6-5ca4-4ad1-bc43-db55233805ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:21Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d476d40d-da35-427f-9019-65f31baaad80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d476d40d-da35-427f-9019-65f31baaad80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4812d2-74dd-47f4-86ce-aa6f44acd425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4812d2-74dd-47f4-86ce-aa6f44acd425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27fa84b6-5ca4-4ad1-bc43-db55233805ba', 'volume_name': 'volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cb0a6a-49f8-4d5f-91f8-82af69cc0aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cb0a6a-49f8-4d5f-91f8-82af69cc0aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d2716d-2e7a-4c7a-9733-c69a07be6a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:20 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume 27fa84b6-5ca4-4ad1-bc43-db55233805ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba', 'volume_size': 1} Sep 15 18:56:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:21 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:56:21 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:21 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d 1073741824" returned: 0 in 0.567s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:21 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d Sep 15 18:56:21 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:21 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.471s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:21 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 Sep 15 18:56:21 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:21 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d" returned: 0 in 0.273s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.030s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1502495230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd7b035-9c7f-4d87-b08f-e2cf8c44d97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:19Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Creating volume abd7b035-9c7f-4d87-b08f-e2cf8c44d97d {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:21 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:21 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d 1073741824 Sep 15 18:56:21 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6a0a3e-8e39-4fc4-be69-764d6ed03c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980db5e2-970a-4301-8cd2-ef3538cacf5d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c02c277-68f7-4c06-899c-d2b73c036d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:21 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume volume-980db5e2-970a-4301-8cd2-ef3538cacf5d (980db5e2-970a-4301-8cd2-ef3538cacf5d): created successfully Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c02c277-68f7-4c06-899c-d2b73c036d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (91282c49-27c3-4a9c-a902-259edfba7491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:21 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d71b3537-cb01-451e-9c74-251f92c6000a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created volume successfully. Sep 15 18:56:21 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3" returned: 0 in 0.476s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:21 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3 Sep 15 18:56:21 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:22 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.3c0be773-9d28-4b29-baab-c44780f891e3" returned: 0 in 0.318s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-3c0be773-9d28-4b29-baab-c44780f891e3" released by "_delete_snapshot" :: held 2.032s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" released by "delete_snapshot" :: held 2.069s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:22 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d 1073741824" returned: 0 in 0.697s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:22 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d Sep 15 18:56:22 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Created reservations ['d6cff4e2-71e7-4734-8a4c-7d70719671e7', '9c8d45b9-5226-48c3-b962-0f314c250baa', '73967eba-83dd-4c30-9b94-4b146c1b7196', '3566b513-9ebc-4a4f-8184-cc7f0544fb78'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:22 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Delete snapshot completed successfully. Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8be9675-2d7e-4f8e-8b49-76f1f1c1b7c0 tempest-SnapshotsActionsTest-218120062 None] Lock "cinder-3c0be773-9d28-4b29-baab-c44780f891e3-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:22 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d" returned: 0 in 0.336s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.516s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-261505486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68034eee-3a02-4d48-9425-24fdc095220e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:20Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Creating volume 68034eee-3a02-4d48-9425-24fdc095220e {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:22 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e647d1f-4c97-4295-b685-08c1577b8d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:22 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e 1073741824 Sep 15 18:56:22 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab580850-1d94-4300-8742-7ef978a5b09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:22 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d (abd7b035-9c7f-4d87-b08f-e2cf8c44d97d): created successfully Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab580850-1d94-4300-8742-7ef978a5b09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (806e29e6-73d2-4c0c-a87f-ab2e9686b695) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:22 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-47e0a5ac-d9d9-4cae-b9e3-3451c394ea38 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created volume successfully. Sep 15 18:56:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-3a0823b0-8b93-4ff7-8a45-0077078f27a8 req-6b1ee6cb-e0cc-4fcb-9ec4-e7028486e7ef tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:23 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e 1073741824" returned: 0 in 0.495s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:23 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e Sep 15 18:56:23 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:23 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e" returned: 0 in 0.340s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.072s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-80487957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:20Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Creating volume 0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:23 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a898bc-96ac-453c-9763-b45efe448534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68034eee-3a02-4d48-9425-24fdc095220e', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602321d4-d45f-4d5f-bec7-54f07a283ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:23 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 1073741824 Sep 15 18:56:23 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:23 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume volume-68034eee-3a02-4d48-9425-24fdc095220e (68034eee-3a02-4d48-9425-24fdc095220e): created successfully Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602321d4-d45f-4d5f-bec7-54f07a283ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (f2a385d1-5abb-44ca-8ffa-1bd356f15078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:23 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7f5fedff-34b4-4e27-ad51-844c060f8f7d tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created volume successfully. Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "cinder-ac06d90e-d960-44ff-88b5-10085e611766-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-ac06d90e-d960-44ff-88b5-10085e611766-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "cinder-quobyte-ac06d90e-d960-44ff-88b5-10085e611766" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-quobyte-ac06d90e-d960-44ff-88b5-10085e611766" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Deleting offline snapshot ac06d90e-d960-44ff-88b5-10085e611766 of volume c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] snapshot_file for this snap is: volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efe6c2-029d-4410-9214-0c5d8b717919]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:24 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:56:24 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:24 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 1073741824" returned: 0 in 0.652s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:24 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 Sep 15 18:56:24 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:24 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.468s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4899b5ea-d1b9-4e34-be06-7d1c181311ce]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:24 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1" returned: 0 in 0.298s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.599s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744522973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fa84b6-5ca4-4ad1-bc43-db55233805ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5014f00a687645cb997279d44f4bb338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:21Z,use_quota=True,user_id='a0ee25b97f0f4d8784cb830675cb605c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Creating volume 27fa84b6-5ca4-4ad1-bc43-db55233805ba {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:24 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40496f0-7e3c-4a29-ab6d-252c1f03e130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:24 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba 1073741824 Sep 15 18:56:24 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb57aae-a85d-4e4a-a3e1-f38c80123dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:24 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 (0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1): created successfully Sep 15 18:56:24 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 Sep 15 18:56:24 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb57aae-a85d-4e4a-a3e1-f38c80123dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (b433fd28-10c3-414e-b431-8925e5672e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:24 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c187935e-fd99-46a6-b2f7-b0a21b9bd1b0 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created volume successfully. Sep 15 18:56:24 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40" returned: 0 in 0.494s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:24 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:56:24 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:25 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba 1073741824" returned: 0 in 0.567s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:25 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba Sep 15 18:56:25 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:25 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.397s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:25 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766 Sep 15 18:56:25 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:25 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba" returned: 0 in 0.314s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-3a0823b0-8b93-4ff7-8a45-0077078f27a8 req-6b1ee6cb-e0cc-4fcb-9ec4-e7028486e7ef tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.639s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-3a0823b0-8b93-4ff7-8a45-0077078f27a8 req-6b1ee6cb-e0cc-4fcb-9ec4-e7028486e7ef tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d2716d-2e7a-4c7a-9733-c69a07be6a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8751e7c5-4510-4911-b43d-2fb653647925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:25 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Volume volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba (27fa84b6-5ca4-4ad1-bc43-db55233805ba): created successfully Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8751e7c5-4510-4911-b43d-2fb653647925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Flow 'volume_create_manager' (5a1ad393-f11c-4cde-8ff4-01eb14d5a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-22a7e7ba-5ac1-47ee-86f5-025c480d7928 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created volume successfully. Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-3a0823b0-8b93-4ff7-8a45-0077078f27a8 req-6b1ee6cb-e0cc-4fcb-9ec4-e7028486e7ef tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-1fddd249-9a52-400b-9e61-8aab534d9666', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32743320-f39b-487a-b93a-e047a7e5d110', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 18:56:25 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40.ac06d90e-d960-44ff-88b5-10085e611766" returned: 0 in 0.289s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-quobyte-ac06d90e-d960-44ff-88b5-10085e611766" released by "_delete_snapshot" :: held 1.807s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" released by "delete_snapshot" :: held 1.839s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-3a0823b0-8b93-4ff7-8a45-0077078f27a8 req-6b1ee6cb-e0cc-4fcb-9ec4-e7028486e7ef tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] attachment_update completed successfully. Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Created reservations ['bbd42104-e2ce-4ebf-b88a-ed9e7c6b424c', 'a8366215-03da-4ea3-af54-758b4b9c3f29', 'b6865213-83db-4389-a9d0-4659630ff799', '110da44f-4d58-49ad-a252-b3b1d1fddd4e'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Delete snapshot completed successfully. Sep 15 18:56:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a6a6cace-9363-4489-9288-9c93df26ef07 tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-ac06d90e-d960-44ff-88b5-10085e611766-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "cinder-c4d388d1-a822-4b02-a4fa-8fee77e8de40-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-c4d388d1-a822-4b02-a4fa-8fee77e8de40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf5443c-6993-4db2-8fe5-f12db72df4cd]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:26 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 Sep 15 18:56:26 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-27fa84b6-5ca4-4ad1-bc43-db55233805ba-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-27fa84b6-5ca4-4ad1-bc43-db55233805ba-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-quobyte-27fa84b6-5ca4-4ad1-bc43-db55233805ba" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-27fa84b6-5ca4-4ad1-bc43-db55233805ba" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:26 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40" returned: 0 in 0.500s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c6931-f944-4022-9992-40db509133e8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:26 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40 Sep 15 18:56:26 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:26 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba Sep 15 18:56:26 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:27 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c4d388d1-a822-4b02-a4fa-8fee77e8de40" returned: 0 in 0.338s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-quobyte-c4d388d1-a822-4b02-a4fa-8fee77e8de40" released by "delete_volume" :: held 0.921s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Created reservations ['06129079-fdfc-4b68-a754-b716a862ff5a', '6af680ec-dbc3-43df-b851-01af9b6d1fd6', '11abd537-daae-41a4-a2f4-e37959156233', '7f348b11-84dc-418a-986e-2519b87faac0'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:27 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba" returned: 0 in 0.430s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:27 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba Sep 15 18:56:27 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:27 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:27 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:27 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27fa84b6-5ca4-4ad1-bc43-db55233805ba" returned: 0 in 0.324s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-27fa84b6-5ca4-4ad1-bc43-db55233805ba" released by "delete_volume" :: held 0.839s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:27 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.303s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:27 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Deleted volume successfully. Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-50566063-4460-4bec-9d4d-418d068241cb tempest-SnapshotsActionsTest-1434127118 None] Lock "cinder-c4d388d1-a822-4b02-a4fa-8fee77e8de40-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created reservations ['1b01c6bd-e371-4828-9eca-6e039b8c03d7', '93b027a5-4f00-4aa8-999f-d5cb8a76b581', 'f6bfc39d-9d52-439b-9e38-7344e67771f9', 'a9bc7b9f-b90d-4a32-ba90-f4c73d48e43f'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:27 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:27 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-quobyte-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d660603-4a69-4d7b-8b7b-ffe4cbb451f3]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:28 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 Sep 15 18:56:28 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:28 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.290s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Deleted volume successfully. Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-504256fb-82ae-4fd8-83a2-04ce0acac416 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-27fa84b6-5ca4-4ad1-bc43-db55233805ba-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:28 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1" returned: 0 in 0.428s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:28 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1 Sep 15 18:56:28 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:28 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1" returned: 0 in 0.347s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1" released by "delete_volume" :: held 0.840s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created reservations ['ba9bfad0-fe15-4812-af4c-38bafae5cfd7', '82923250-4760-4055-a8a2-2b6981b247c2', '90b7add8-bbcc-41b1-8e0f-8b2d951245a1', 'f7addf63-e8f8-4b47-be0a-f11a3d22c71d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-63af5cdd-54f6-49af-a823-8271c36c7bcf req-af9b80a6-4fa3-48e6-8bb1-e46f2289dad0 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Terminate volume connection completed successfully. Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-63af5cdd-54f6-49af-a823-8271c36c7bcf req-af9b80a6-4fa3-48e6-8bb1-e46f2289dad0 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Deleting attachment 32743320-f39b-487a-b93a-e047a7e5d110. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 18:56:29 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:29 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-68034eee-3a02-4d48-9425-24fdc095220e-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-68034eee-3a02-4d48-9425-24fdc095220e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-quobyte-68034eee-3a02-4d48-9425-24fdc095220e" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-68034eee-3a02-4d48-9425-24fdc095220e" acquired by "delete_volume" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[846b4152-36c2-4ce6-94f7-f054d549816a]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:29 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e Sep 15 18:56:29 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:29 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.493s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Deleted volume successfully. Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-fa869af8-3a6c-42d2-84b4-7402ad482b8a tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-0c8ad7df-4c4b-49c0-a97b-f29049b4c6d1-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:29 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e" returned: 0 in 0.519s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Acquiring lock "cinder-1fddd249-9a52-400b-9e61-8aab534d9666-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:29 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e Sep 15 18:56:29 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "cinder-1fddd249-9a52-400b-9e61-8aab534d9666-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Acquiring lock "cinder-quobyte-1fddd249-9a52-400b-9e61-8aab534d9666" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "cinder-quobyte-1fddd249-9a52-400b-9e61-8aab534d9666" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eccf0b-b983-4efc-a1bd-429d5716b1c1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:30 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-68034eee-3a02-4d48-9425-24fdc095220e" returned: 0 in 0.341s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-68034eee-3a02-4d48-9425-24fdc095220e" released by "delete_volume" :: held 0.932s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:30 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666 Sep 15 18:56:30 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created reservations ['1dad440b-55e1-41d2-b92e-d9e63a8c87b9', '5c2fb07e-0534-4001-8c49-e73954d7ce5c', '269ce3df-f5be-4261-8555-5ad4f50da030', '9769d7f0-3846-4f08-a4db-cf20ab11a847'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:30 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:30 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:30 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666" returned: 0 in 0.603s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:30 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666 Sep 15 18:56:30 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:30 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.394s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:30 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Deleted volume successfully. Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d3ac0d8a-e6de-48d5-a240-f15b4953d3c7 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-68034eee-3a02-4d48-9425-24fdc095220e-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:30 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1fddd249-9a52-400b-9e61-8aab534d9666" returned: 0 in 0.310s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "cinder-quobyte-1fddd249-9a52-400b-9e61-8aab534d9666" released by "delete_volume" :: held 0.977s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:30 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Created reservations ['9344b263-6c8a-4188-bd63-7b6d16324908', 'a2b8bd06-919d-42c0-9eee-206616aa76f4', '098bb0b8-1e7c-4cb9-ad9b-e243308848cb', '78864404-95f7-4a70-a488-297f928d61d6'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:31 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:31 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:31 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.307s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Deleted volume successfully. Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1da3dc78-20f8-4863-957a-3ec143b487e3 tempest-TestServerVolumeAttachScenarioOldVersion-2029858024 None] Lock "cinder-1fddd249-9a52-400b-9e61-8aab534d9666-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-quobyte-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b4822-dff6-4ffc-b7f0-1df62a2c459d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:31 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d Sep 15 18:56:31 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:31 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d" returned: 0 in 0.435s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:32 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d Sep 15 18:56:32 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:32 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d" returned: 0 in 0.369s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d" released by "delete_volume" :: held 0.858s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created reservations ['aac0a573-a3f5-4d8b-be49-799648ea7164', '791bfa14-6eae-492d-9649-8692df434a65', '1ee4654a-f276-47b6-bfc8-6161c37b2e2f', '2e5a9df1-937c-49e5-8bd3-66c60c7a9abd'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:32 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:32 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:33 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.502s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:33 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Deleted volume successfully. Sep 15 18:56:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ad611a87-6932-48ea-bc92-3d6c0005af03 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-abd7b035-9c7f-4d87-b08f-e2cf8c44d97d-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-980db5e2-970a-4301-8cd2-ef3538cacf5d-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-980db5e2-970a-4301-8cd2-ef3538cacf5d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-quobyte-980db5e2-970a-4301-8cd2-ef3538cacf5d" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-980db5e2-970a-4301-8cd2-ef3538cacf5d" acquired by "delete_volume" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:33 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b775981-e317-42c4-90fc-904044b2f4f5]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:34 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d Sep 15 18:56:34 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:34 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d" returned: 0 in 0.551s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:34 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d Sep 15 18:56:34 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:34 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-980db5e2-970a-4301-8cd2-ef3538cacf5d" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-980db5e2-970a-4301-8cd2-ef3538cacf5d" released by "delete_volume" :: held 0.986s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:34 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created reservations ['8b9d6683-8c06-4d68-9e8c-44c479a522cd', '77037fb5-dc9e-4780-9322-3f8ea38f991d', '56dcdbd3-0b0d-4917-af5d-f4841ab2d85f', '60b11fd3-54df-446f-add6-daa311a8c55b'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:35 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:35 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:35 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.281s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:35 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:35 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Deleted volume successfully. Sep 15 18:56:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-16e32cc2-2bda-44f2-a97e-b819bf6d8400 tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-980db5e2-970a-4301-8cd2-ef3538cacf5d-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "cinder-quobyte-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:36 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d015dc-cafa-491f-97a1-290610ef3939]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:36 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e Sep 15 18:56:36 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:36 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e" returned: 0 in 0.496s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:36 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e Sep 15 18:56:36 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:37 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e" returned: 0 in 0.335s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-quobyte-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e" released by "delete_volume" :: held 0.903s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Created reservations ['5dacbac0-3ef4-430a-8d67-71379011a233', '728db9c9-c38b-4198-bae8-9ef80c9461c1', '2b1039c8-10a7-42f6-9146-e77b261514be', 'd2cdbd66-aa2f-4661-918d-a9df077efc82'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:37 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:37 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:37 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.404s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Deleted volume successfully. Sep 15 18:56:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-ef7cbe29-f15e-46fd-bfcd-63e1cbd8ec5b tempest-CreateVolumesFromSourceVolumeTest-1180946718 None] Lock "cinder-59e5fa7a-8984-4b6a-ba1e-e47dd63fc05e-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:39 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Flow 'volume_create_manager' (1cc130a5-5fdf-427e-8237-8e2b72b8f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b7ed8c-1f93-4cf5-bb52-580df404e8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b7ed8c-1f93-4cf5-bb52-580df404e8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78a7e10-13a3-480d-b37f-a5573bee0575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9abc0e15e848f89e60ad7919bd21ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:40Z,use_quota=True,user_id='2e284cdfdb0849efa062e399a29e713e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4503a312-747b-453a-8cde-4e5a5592653d),volume_type_id=4503a312-747b-453a-8cde-4e5a5592653d)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50d03f2-2370-448d-ad9a-fb12edebf274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50d03f2-2370-448d-ad9a-fb12edebf274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ce51ac-e157-41b4-a05a-c1ab1ceeba05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:39 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0ce51ac-e157-41b4-a05a-c1ab1ceeba05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f78a7e10-13a3-480d-b37f-a5573bee0575', 'volume_name': 'volume-f78a7e10-13a3-480d-b37f-a5573bee0575', 'volume_size': 1, 'image_id': 'e279cb0c-dd16-4864-a28a-51c819c94651', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e279cb0c-dd16-4864-a28a-51c819c94651', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3579e92de8090d6a80e1abc2c45ad451', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c9abc0e15e848f89e60ad7919bd21ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d8772f0843829b4aad39e9bbac6b98e1a7f07428b33f85a4e8d19fccc1089f463aa6fbe9f0bda586fc560cabf6f1526b652a0c2cdca7650749048d1645bac82', 'id': 'e279cb0c-dd16-4864-a28a-51c819c94651', 'created_at': datetime.datetime(2026, 9, 15, 16, 56, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e279cb0c-dd16-4864-a28a-51c819c94651/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8596a00-29ea-4d60-a554-20adc948dc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8596a00-29ea-4d60-a554-20adc948dc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75f1f54-db89-4aef-b6a4-fbd6779b333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:40 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Volume f78a7e10-13a3-480d-b37f-a5573bee0575: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f78a7e10-13a3-480d-b37f-a5573bee0575', 'volume_size': 1, 'image_id': 'e279cb0c-dd16-4864-a28a-51c819c94651', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e279cb0c-dd16-4864-a28a-51c819c94651', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3579e92de8090d6a80e1abc2c45ad451', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c9abc0e15e848f89e60ad7919bd21ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d8772f0843829b4aad39e9bbac6b98e1a7f07428b33f85a4e8d19fccc1089f463aa6fbe9f0bda586fc560cabf6f1526b652a0c2cdca7650749048d1645bac82', 'id': 'e279cb0c-dd16-4864-a28a-51c819c94651', 'created_at': datetime.datetime(2026, 9, 15, 16, 56, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e279cb0c-dd16-4864-a28a-51c819c94651/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Trying to clone f78a7e10-13a3-480d-b37f-a5573bee0575 from image e279cb0c-dd16-4864-a28a-51c819c94651 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e279cb0c-dd16-4864-a28a-51c819c94651', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 18:56:40 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Image download 0.00 MB at 0.00 MB/s Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40d6766-8696-4753-b495-ae753c38f737]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:40 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD Sep 15 18:56:40 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:40 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:41 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD Sep 15 18:56:41 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:41 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:56:41 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Temporary image e279cb0c-dd16-4864-a28a-51c819c94651 is fetched for user 2e284cdfdb0849efa062e399a29e713e. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 18:56:41 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c92c99d-7ff7-4132-b20d-d5bb18022e80]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:41 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD Sep 15 18:56:41 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:41 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:41 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD Sep 15 18:56:41 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:42 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD" returned: 1 in 0.419s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78a7e10-13a3-480d-b37f-a5573bee0575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9abc0e15e848f89e60ad7919bd21ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:40Z,use_quota=True,user_id='2e284cdfdb0849efa062e399a29e713e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4503a312-747b-453a-8cde-4e5a5592653d),volume_type_id=4503a312-747b-453a-8cde-4e5a5592653d)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Creating volume f78a7e10-13a3-480d-b37f-a5573bee0575 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:42 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:42 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 1073741824 Sep 15 18:56:42 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Flow 'volume_create_manager' (12d1acad-cd89-40b4-8c0d-977e64cdb432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea83a37-fac9-4507-9b8e-a3dccd29a20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea83a37-fac9-4507-9b8e-a3dccd29a20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1223546659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a750949-d1dd-4a76-9c74-c3730024e777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a25dc8a9ec49bbbb9f029b03c88daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:42Z,use_quota=True,user_id='7a96c313ef4a4d7eb2d6da76378e4bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592d66ba-03e9-46be-9a2c-19a8841411ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592d66ba-03e9-46be-9a2c-19a8841411ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95addef6-47f4-4f41-b78d-f1e445b22712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95addef6-47f4-4f41-b78d-f1e445b22712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a750949-d1dd-4a76-9c74-c3730024e777', 'volume_name': 'volume-1a750949-d1dd-4a76-9c74-c3730024e777', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03461570-ff18-46b8-816b-4b6d91ba4b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03461570-ff18-46b8-816b-4b6d91ba4b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9223d8ba-3a5b-4949-9867-0988b7f88e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:42 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Volume 1a750949-d1dd-4a76-9c74-c3730024e777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a750949-d1dd-4a76-9c74-c3730024e777', 'volume_size': 1} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:42 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 1073741824" returned: 0 in 0.541s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:42 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 Sep 15 18:56:42 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:43 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575" returned: 0 in 0.263s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1223546659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a750949-d1dd-4a76-9c74-c3730024e777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a25dc8a9ec49bbbb9f029b03c88daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:42Z,use_quota=True,user_id='7a96c313ef4a4d7eb2d6da76378e4bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Creating volume 1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:43 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:43 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 1073741824 Sep 15 18:56:43 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Attempting download of e279cb0c-dd16-4864-a28a-51c819c94651 ((None, [{'url': 'file:///opt/stack/data/glance/images/e279cb0c-dd16-4864-a28a-51c819c94651', 'metadata': {}}])) to volume f78a7e10-13a3-480d-b37f-a5573bee0575. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8599ea7-6465-4962-80e5-99472e360fe4]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e279cb0c-dd16-4864-a28a-51c819c94651_vd53eu4e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:43 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e279cb0c-dd16-4864-a28a-51c819c94651_vd53eu4e Sep 15 18:56:43 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:43 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e279cb0c-dd16-4864-a28a-51c819c94651_vd53eu4e" returned: 0 in 0.468s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e279cb0c-dd16-4864-a28a-51c819c94651_vd53eu4e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:43 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 1073741824" returned: 0 in 0.648s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:43 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 Sep 15 18:56:43 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:43 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e279cb0c-dd16-4864-a28a-51c819c94651_vd53eu4e Sep 15 18:56:43 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:44 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777" returned: 0 in 0.285s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9223d8ba-3a5b-4949-9867-0988b7f88e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a750949-d1dd-4a76-9c74-c3730024e777', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4c42c4-41a4-4881-b362-0a7b41b1f09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:44 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Volume volume-1a750949-d1dd-4a76-9c74-c3730024e777 (1a750949-d1dd-4a76-9c74-c3730024e777): created successfully Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4c42c4-41a4-4881-b362-0a7b41b1f09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Flow 'volume_create_manager' (12d1acad-cd89-40b4-8c0d-977e64cdb432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:44 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e279cb0c-dd16-4864-a28a-51c819c94651_vd53eu4e" returned: 1 in 0.484s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e279cb0c-dd16-4864-a28a-51c819c94651_vd53eu4e' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:56:44 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d70dd959-fd49-4f67-87bb-7edac3371f3b tempest-VolumeDependencyTests-967019085 None] Created volume successfully. Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f0e61-0031-4d92-b567-381a3ff23041]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:44 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD Sep 15 18:56:44 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:44 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Creating offline snapshot bdc6e573-e427-44ec-8b13-8c28f3e5af62 of volume 1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:56:44 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD Sep 15 18:56:44 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bbfdf4-709f-45c7-b7ff-29b345798adf]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:44 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 Sep 15 18:56:44 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:45 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] e279cb0c-dd16-4864-a28a-51c819c94651 was raw, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:45 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 Sep 15 18:56:45 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:45 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777" returned: 0 in 0.505s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:45 devstack sudo[100822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 1G Sep 15 18:56:45 devstack sudo[100822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:45 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575" returned: 0 in 0.632s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e279cb0c-dd16-4864-a28a-51c819c94651_g1x_ee1vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:56:45 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Converted 0.00 MB image at 0.00 MB/s Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:45 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 1G Sep 15 18:56:45 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:45 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:45 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:45 devstack sudo[100822]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 1G" returned: 0 in 0.594s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a750949-d1dd-4a76-9c74-c3730024e777 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:45 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a750949-d1dd-4a76-9c74-c3730024e777 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 Sep 15 18:56:45 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:46 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 1G" returned: 0 in 0.417s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Downloaded image e279cb0c-dd16-4864-a28a-51c819c94651 ((None, [{'url': 'file:///opt/stack/data/glance/images/e279cb0c-dd16-4864-a28a-51c819c94651', 'metadata': {}}])) to volume f78a7e10-13a3-480d-b37f-a5573bee0575 successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Temporary image e279cb0c-dd16-4864-a28a-51c819c94651 for user 2e284cdfdb0849efa062e399a29e713e is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Marking volume f78a7e10-13a3-480d-b37f-a5573bee0575 as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Copying metadata from image e279cb0c-dd16-4864-a28a-51c819c94651 to f78a7e10-13a3-480d-b37f-a5573bee0575. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Creating volume glance metadata for volume f78a7e10-13a3-480d-b37f-a5573bee0575 backed by image e279cb0c-dd16-4864-a28a-51c819c94651 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e279cb0c-dd16-4864-a28a-51c819c94651', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3579e92de8090d6a80e1abc2c45ad451', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 18:56:46 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.366s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75f1f54-db89-4aef-b6a4-fbd6779b333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78a7e10-13a3-480d-b37f-a5573bee0575', 'volume_size': 1, 'image_id': 'e279cb0c-dd16-4864-a28a-51c819c94651', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e279cb0c-dd16-4864-a28a-51c819c94651', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3579e92de8090d6a80e1abc2c45ad451', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8c9abc0e15e848f89e60ad7919bd21ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d8772f0843829b4aad39e9bbac6b98e1a7f07428b33f85a4e8d19fccc1089f463aa6fbe9f0bda586fc560cabf6f1526b652a0c2cdca7650749048d1645bac82', 'id': 'e279cb0c-dd16-4864-a28a-51c819c94651', 'created_at': datetime.datetime(2026, 9, 15, 16, 56, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 56, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e279cb0c-dd16-4864-a28a-51c819c94651/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631a627b-9a37-4d54-ac39-403c6356afc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:46 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Volume volume-f78a7e10-13a3-480d-b37f-a5573bee0575 (f78a7e10-13a3-480d-b37f-a5573bee0575): created successfully Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631a627b-9a37-4d54-ac39-403c6356afc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Flow 'volume_create_manager' (1cc130a5-5fdf-427e-8237-8e2b72b8f968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0987733c-9336-4b65-bf05-5c369d3a648c tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Created volume successfully. Sep 15 18:56:46 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a750949-d1dd-4a76-9c74-c3730024e777 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62" returned: 0 in 0.433s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:46 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 is being set with open permissions: ugo+rw Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:46 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 Sep 15 18:56:46 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:46 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62" returned: 0 in 0.371s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:46 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.info Sep 15 18:56:46 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:47 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.info" returned: 0 in 0.275s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:47 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.info is being set with open permissions: ugo+rw Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:47 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.info Sep 15 18:56:47 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:47 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.info" returned: 0 in 0.316s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8b5f6a6a-9546-40e9-bf64-e5bf0ace703d tempest-VolumeDependencyTests-967019085 None] Create snapshot completed successfully Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Acquiring lock "cinder-f78a7e10-13a3-480d-b37f-a5573bee0575-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "cinder-f78a7e10-13a3-480d-b37f-a5573bee0575-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Acquiring lock "cinder-quobyte-f78a7e10-13a3-480d-b37f-a5573bee0575" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "cinder-quobyte-f78a7e10-13a3-480d-b37f-a5573bee0575" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a92165-22b0-4711-a1b5-ce0ad4259b04]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:47 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 Sep 15 18:56:47 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:48 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575" returned: 0 in 0.464s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:48 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575 Sep 15 18:56:48 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:48 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f78a7e10-13a3-480d-b37f-a5573bee0575" returned: 0 in 0.363s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "cinder-quobyte-f78a7e10-13a3-480d-b37f-a5573bee0575" released by "delete_volume" :: held 0.911s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:48 devstack cinder-volume[86137]: WARNING cinder.quota [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:56:48 devstack cinder-volume[86137]: WARNING cinder.quota [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Created reservations ['93c2f229-5b5f-45d2-afa3-15e4fa40b68a', '905c66f4-a9cc-4218-929c-ddd7a36b5368', 'e20daebb-4fa2-45ee-8e1a-204fc250d824', '6c8e7f54-036c-4b38-8f2b-56ec4b6388a4'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Flow 'volume_create_manager' (1bbca523-89d1-4d29-a3e6-dcb675ba099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f455a11-dbf4-46a8-afd7-0ce25d67ead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f455a11-dbf4-46a8-afd7-0ce25d67ead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-331959421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a25dc8a9ec49bbbb9f029b03c88daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bdc6e573-e427-44ec-8b13-8c28f3e5af62,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:49Z,use_quota=True,user_id='7a96c313ef4a4d7eb2d6da76378e4bb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19c290e-a8c2-440b-84e5-937d22977904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19c290e-a8c2-440b-84e5-937d22977904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dba9ea8-072c-4646-9c90-8beea0c93f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dba9ea8-072c-4646-9c90-8beea0c93f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c', 'volume_name': 'volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c', 'volume_size': 1, 'snapshot_id': 'bdc6e573-e427-44ec-8b13-8c28f3e5af62'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18719e5-11fa-4d78-8fc4-7aadcce15de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18719e5-11fa-4d78-8fc4-7aadcce15de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d34d60-4e13-405c-84a0-c8b02102a8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:48 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Volume 27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c', 'volume_size': 1, 'snapshot_id': 'bdc6e573-e427-44ec-8b13-8c28f3e5af62'} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Acquiring lock "cinder-quobyte-bdc6e573-e427-44ec-8b13-8c28f3e5af62-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" by "_create_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-bdc6e573-e427-44ec-8b13-8c28f3e5af62-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Creating volume 27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c from snapshot bdc6e573-e427-44ec-8b13-8c28f3e5af62 {{(pid=86137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Acquiring lock "cinder-quobyte-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:48 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:56:48 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] snapshot: bdc6e573-e427-44ec-8b13-8c28f3e5af62, volume: 27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02553f5-7d7f-4689-b306-36af60d94c93]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:49 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 Sep 15 18:56:49 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:49 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.309s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:56:49 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Deleted volume successfully. Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-84a81c65-c264-4a1e-a99d-0129040a648d tempest-VolumeAndVolumeTypeFromImageTest-215963780 None] Lock "cinder-f78a7e10-13a3-480d-b37f-a5573bee0575-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:49 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62" returned: 0 in 0.456s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a750949-d1dd-4a76-9c74-c3730024e777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0de9e3-9038-4b05-ba72-015025b69299]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:49 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 Sep 15 18:56:49 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:49 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777" returned: 0 in 0.434s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 18:56:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:49 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c Sep 15 18:56:49 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (bc0ed78b-e2a3-42e4-84c4-5c213cfd4f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d1926f-a8e0-4155-b477-9ef220283111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d1926f-a8e0-4155-b477-9ef220283111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070404593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5553f5-0061-477c-b25f-044f31794f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:55Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6758525b-7ce5-4eb7-afdc-39b8e5f60f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6758525b-7ce5-4eb7-afdc-39b8e5f60f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774609d-570a-41fd-bf2c-b9de10fd42f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774609d-570a-41fd-bf2c-b9de10fd42f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f5553f5-0061-477c-b25f-044f31794f45', 'volume_name': 'volume-8f5553f5-0061-477c-b25f-044f31794f45', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee419b1-35a0-4980-a548-eb2c2846ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee419b1-35a0-4980-a548-eb2c2846ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88795af-9d90-473c-9fa3-7782ed905bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:54 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume 8f5553f5-0061-477c-b25f-044f31794f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f5553f5-0061-477c-b25f-044f31794f45', 'volume_size': 1} Sep 15 18:56:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:58 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" returned: 0 in 8.963s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:58 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777, size 1024.00 MB, duration 8.96 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:56:58 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Converted 1024.00 MB image at 114.23 MB/s Sep 15 18:56:58 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c is being set with open permissions: ugo+rw Sep 15 18:56:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:58 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c Sep 15 18:56:58 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:58 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (c2d1b3b7-6556-4a6a-b20b-fdf210ec7089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a604c82b-b0a3-4599-a08a-509ba89ed58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a604c82b-b0a3-4599-a08a-509ba89ed58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-725133962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227e5346-4f89-4120-93b2-66d726ad0a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:59Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8099b9e2-91d8-448e-ab13-8088f8ce3582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8099b9e2-91d8-448e-ab13-8088f8ce3582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c61b9f-76a1-4959-8701-0587998b5914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c61b9f-76a1-4959-8701-0587998b5914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227e5346-4f89-4120-93b2-66d726ad0a5f', 'volume_name': 'volume-227e5346-4f89-4120-93b2-66d726ad0a5f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa9e906-319a-4c6b-9783-c141d7f5a960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa9e906-319a-4c6b-9783-c141d7f5a960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd767bc8-b230-4114-a2dd-7ba7f3539220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Volume 227e5346-4f89-4120-93b2-66d726ad0a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227e5346-4f89-4120-93b2-66d726ad0a5f', 'volume_size': 1} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:59 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" returned: 0 in 0.364s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" released by "_copy_volume_from_snapshot" :: held 10.336s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-bdc6e573-e427-44ec-8b13-8c28f3e5af62-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" released by "_create_volume_from_snapshot" :: held 10.417s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.459s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.415s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070404593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5553f5-0061-477c-b25f-044f31794f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:55Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Creating volume 8f5553f5-0061-477c-b25f-044f31794f45 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:56:59 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:56:59 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 1073741824 Sep 15 18:56:59 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d34d60-4e13-405c-84a0-c8b02102a8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c', 'volume_size': 1, 'snapshot_id': 'bdc6e573-e427-44ec-8b13-8c28f3e5af62'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44be6ecb-fe2d-4e4e-b4bc-bc1beba99382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (9db88d4f-9803-48df-90d8-0511e71da2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a65eda-6765-480b-9dc0-e2c6d0208810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Volume volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c (27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c): created successfully Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44be6ecb-fe2d-4e4e-b4bc-bc1beba99382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Flow 'volume_create_manager' (1bbca523-89d1-4d29-a3e6-dcb675ba099a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a65eda-6765-480b-9dc0-e2c6d0208810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233903089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddcbb35-53d3-4c97-bc44-1d1aa5877bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:59Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3eb16f-cc88-4fc8-b904-aed164d2fb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3eb16f-cc88-4fc8-b904-aed164d2fb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55cfb5f-ad53-490a-ad55-d3f7fd44458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55cfb5f-ad53-490a-ad55-d3f7fd44458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fddcbb35-53d3-4c97-bc44-1d1aa5877bae', 'volume_name': 'volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c09114-866f-4793-97ac-34c43dfb39a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c09114-866f-4793-97ac-34c43dfb39a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc67e82-741d-4f16-88eb-18088e5f0040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Volume fddcbb35-53d3-4c97-bc44-1d1aa5877bae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae', 'volume_size': 1} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:56:59 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e0423cea-7352-468d-bb63-539fc79649bf tempest-VolumeDependencyTests-967019085 None] Created volume successfully. Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (62431735-470c-47d6-aff1-38e8b931691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6120a54f-030d-4935-b770-834240bdd83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Acquiring lock "cinder-bdc6e573-e427-44ec-8b13-8c28f3e5af62-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-bdc6e573-e427-44ec-8b13-8c28f3e5af62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Acquiring lock "cinder-quobyte-1a750949-d1dd-4a76-9c74-c3730024e777" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6120a54f-030d-4935-b770-834240bdd83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631518906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74dd889-c4e9-4ed6-b737-963b063d9202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:00Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1180c7-2fc5-41b4-9763-b1706e5676ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d1180c7-2fc5-41b4-9763-b1706e5676ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba93b5bb-851d-4a75-ac6a-5d092d8e0717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba93b5bb-851d-4a75-ac6a-5d092d8e0717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74dd889-c4e9-4ed6-b737-963b063d9202', 'volume_name': 'volume-f74dd889-c4e9-4ed6-b737-963b063d9202', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:56:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fc85e2-484d-4fe5-8dbc-156312f4ff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44fc85e2-484d-4fe5-8dbc-156312f4ff7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5be0d03-240b-4098-8c6b-b8151dc0ecfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Volume f74dd889-c4e9-4ed6-b737-963b063d9202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74dd889-c4e9-4ed6-b737-963b063d9202', 'volume_size': 1} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 1073741824" returned: 0 in 0.715s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-1a750949-d1dd-4a76-9c74-c3730024e777" acquired by "delete_snapshot" :: waited 0.117s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Acquiring lock "cinder-quobyte-bdc6e573-e427-44ec-8b13-8c28f3e5af62" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-bdc6e573-e427-44ec-8b13-8c28f3e5af62" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Deleting offline snapshot bdc6e573-e427-44ec-8b13-8c28f3e5af62 of volume 1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] snapshot_file for this snap is: volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ef6068-6cd2-4b79-829a-47958e5590cf]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:00 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 Sep 15 18:57:00 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:00 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 Sep 15 18:57:00 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (fb125f0f-b615-489a-ad2c-67a01050141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae437c6-d37a-4b32-9cf8-04571cdd38c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae437c6-d37a-4b32-9cf8-04571cdd38c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-86236550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6dcbf9-0e0c-4534-8582-b819828b126d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:00Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ad4bdb-3a0f-4ac6-9967-7b1f9e197848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ad4bdb-3a0f-4ac6-9967-7b1f9e197848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e75fc0-5fbc-4361-9fa8-601f25c62beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e75fc0-5fbc-4361-9fa8-601f25c62beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6dcbf9-0e0c-4534-8582-b819828b126d', 'volume_name': 'volume-7c6dcbf9-0e0c-4534-8582-b819828b126d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5835f8ba-4f8e-4def-b083-f0f0fe268cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5835f8ba-4f8e-4def-b083-f0f0fe268cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0bf7af-d78f-4770-8f8f-bdc018a8ff56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:00 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Volume 7c6dcbf9-0e0c-4534-8582-b819828b126d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6dcbf9-0e0c-4534-8582-b819828b126d', 'volume_size': 1} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-725133962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227e5346-4f89-4120-93b2-66d726ad0a5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:59Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Creating volume 227e5346-4f89-4120-93b2-66d726ad0a5f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:00 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88795af-9d90-473c-9fa3-7782ed905bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f5553f5-0061-477c-b25f-044f31794f45', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219a286b-7fdb-4eed-b197-80f8f8678ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f 1073741824 Sep 15 18:57:00 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:00 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume volume-8f5553f5-0061-477c-b25f-044f31794f45 (8f5553f5-0061-477c-b25f-044f31794f45): created successfully Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219a286b-7fdb-4eed-b197-80f8f8678ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (bc0ed78b-e2a3-42e4-84c4-5c213cfd4f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-622c9b02-ff18-4c07-bcba-706f0287da1f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created volume successfully. Sep 15 18:57:00 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62" returned: 0 in 0.566s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a750949-d1dd-4a76-9c74-c3730024e777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb4b423-ddec-4080-85f9-e9606b920e20]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:00 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 Sep 15 18:57:00 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (2171a50e-ecca-498f-8e8a-27f4a3f54d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db205dce-e40e-4034-bd7e-1800200b0567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db205dce-e40e-4034-bd7e-1800200b0567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-517735944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82f8a09-f295-44d0-96a0-360a98d980ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:01Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2704ce5-7070-4fed-81a0-3c74bf61644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2704ce5-7070-4fed-81a0-3c74bf61644b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70485215-b2fe-4754-b3ef-c3bef3ff3d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70485215-b2fe-4754-b3ef-c3bef3ff3d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd82f8a09-f295-44d0-96a0-360a98d980ba', 'volume_name': 'volume-d82f8a09-f295-44d0-96a0-360a98d980ba', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628f1c94-913e-41f0-b165-c079e6c45614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628f1c94-913e-41f0-b165-c079e6c45614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c6e4ca-bd81-4c16-aa86-de50f7654a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:00 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Volume d82f8a09-f295-44d0-96a0-360a98d980ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d82f8a09-f295-44d0-96a0-360a98d980ba', 'volume_size': 1} Sep 15 18:57:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:01 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f 1073741824" returned: 0 in 0.594s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:01 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f Sep 15 18:57:01 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:01 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f" returned: 0 in 0.307s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.908s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-233903089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fddcbb35-53d3-4c97-bc44-1d1aa5877bae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:56:59Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Creating volume fddcbb35-53d3-4c97-bc44-1d1aa5877bae {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:01 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:01 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777" returned: 0 in 0.693s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:01 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae 1073741824 Sep 15 18:57:01 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd767bc8-b230-4114-a2dd-7ba7f3539220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227e5346-4f89-4120-93b2-66d726ad0a5f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:01 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 Sep 15 18:57:01 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2962e209-cc08-4ced-b7dd-f7cabc29bf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:01 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Volume volume-227e5346-4f89-4120-93b2-66d726ad0a5f (227e5346-4f89-4120-93b2-66d726ad0a5f): created successfully Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2962e209-cc08-4ced-b7dd-f7cabc29bf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (c2d1b3b7-6556-4a6a-b20b-fdf210ec7089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:01 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-fa224418-5cfb-4d65-acac-5cbcf296b314 tempest-CreateVolumesFromImageTest-488265274 None] Created volume successfully. Sep 15 18:57:01 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62" returned: 0 in 0.443s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:01 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62 Sep 15 18:57:01 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:02 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae 1073741824" returned: 0 in 0.577s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:02 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae Sep 15 18:57:02 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:02 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777.bdc6e573-e427-44ec-8b13-8c28f3e5af62" returned: 0 in 0.295s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-bdc6e573-e427-44ec-8b13-8c28f3e5af62" released by "_delete_snapshot" :: held 2.169s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-1a750949-d1dd-4a76-9c74-c3730024e777" released by "delete_snapshot" :: held 2.216s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:02 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Created reservations ['ac2851fb-2843-4908-9f05-a7c69401662f', '17774f3d-5d66-427c-933d-330a2600eb7c', '34282f36-b172-43cb-8bd5-992a3f3f5987', 'bc2d01e9-4c9c-47e0-ab92-b978bd7272d8'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae" returned: 0 in 0.264s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.330s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-631518906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74dd889-c4e9-4ed6-b737-963b063d9202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:00Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Creating volume f74dd889-c4e9-4ed6-b737-963b063d9202 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:02 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc67e82-741d-4f16-88eb-18088e5f0040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:02 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202 1073741824 Sep 15 18:57:02 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde5a2c0-23ee-4a93-af23-54e40f2e4b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:02 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Volume volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae (fddcbb35-53d3-4c97-bc44-1d1aa5877bae): created successfully Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde5a2c0-23ee-4a93-af23-54e40f2e4b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (9db88d4f-9803-48df-90d8-0511e71da2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-13baae32-9585-414e-be3b-e65d50678a7b tempest-CreateVolumesFromImageTest-488265274 None] Created volume successfully. Sep 15 18:57:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Delete snapshot completed successfully. Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-17a03449-e8d5-4659-894d-ef68876b3d13 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-bdc6e573-e427-44ec-8b13-8c28f3e5af62-delete_snapshot" released by "delete_snapshot" :: held 2.546s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:02 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202 1073741824" returned: 0 in 0.509s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:02 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202 Sep 15 18:57:02 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:03 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.724s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-86236550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6dcbf9-0e0c-4534-8582-b819828b126d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:00Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Creating volume 7c6dcbf9-0e0c-4534-8582-b819828b126d {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:03 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Acquiring lock "cinder-1a750949-d1dd-4a76-9c74-c3730024e777-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:03 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d 1073741824 Sep 15 18:57:03 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5be0d03-240b-4098-8c6b-b8151dc0ecfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74dd889-c4e9-4ed6-b737-963b063d9202', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360c3dc4-cf59-41df-b856-5bdfb27e26a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-1a750949-d1dd-4a76-9c74-c3730024e777-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Volume volume-f74dd889-c4e9-4ed6-b737-963b063d9202 (f74dd889-c4e9-4ed6-b737-963b063d9202): created successfully Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360c3dc4-cf59-41df-b856-5bdfb27e26a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (62431735-470c-47d6-aff1-38e8b931691b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:03 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-543ebd35-be40-4516-9613-b43a9c1f3bda tempest-CreateVolumesFromImageTest-488265274 None] Created volume successfully. Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Acquiring lock "cinder-quobyte-1a750949-d1dd-4a76-9c74-c3730024e777" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-1a750949-d1dd-4a76-9c74-c3730024e777" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[85be1f8b-cc9d-42ef-ab41-709120f3149c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:03 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 Sep 15 18:57:03 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:03 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d 1073741824" returned: 0 in 0.515s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:03 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d Sep 15 18:57:03 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:03 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777" returned: 0 in 0.466s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:03 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777 Sep 15 18:57:03 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:04 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d" returned: 0 in 0.294s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.065s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-517735944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82f8a09-f295-44d0-96a0-360a98d980ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9094d62c8e9843a9b256a99402e45791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:01Z,use_quota=True,user_id='4eeac0364576467480d90057f1b9644a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Creating volume d82f8a09-f295-44d0-96a0-360a98d980ba {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:04 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0bf7af-d78f-4770-8f8f-bdc018a8ff56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6dcbf9-0e0c-4534-8582-b819828b126d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ca0437-540b-4150-a7d9-de35744ebdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Volume volume-7c6dcbf9-0e0c-4534-8582-b819828b126d (7c6dcbf9-0e0c-4534-8582-b819828b126d): created successfully Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ca0437-540b-4150-a7d9-de35744ebdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (fb125f0f-b615-489a-ad2c-67a01050141b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:04 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba 1073741824 Sep 15 18:57:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-2632a518-1524-4d68-ad04-78398165a051 tempest-CreateVolumesFromImageTest-488265274 None] Created volume successfully. Sep 15 18:57:04 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:04 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a750949-d1dd-4a76-9c74-c3730024e777" returned: 0 in 0.355s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-1a750949-d1dd-4a76-9c74-c3730024e777" released by "delete_volume" :: held 0.917s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Created reservations ['54a46855-88d2-4e88-a049-9d5333ae3391', '1ec3dbc1-93e7-43ce-943c-21ba39a01fc2', '998976fb-9a1a-4428-9f9f-5b0e272d4656', '6265641b-a3a7-428c-9632-17bb9e3c356d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:04 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:04 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:04 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba 1073741824" returned: 0 in 0.658s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:04 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.352s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Deleted volume successfully. Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c299408c-4678-42e0-b5b7-489d38ecc1f2 tempest-VolumeDependencyTests-967019085 None] Lock "cinder-1a750949-d1dd-4a76-9c74-c3730024e777-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:04 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba Sep 15 18:57:04 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:05 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba" returned: 0 in 0.263s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.693s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c6e4ca-bd81-4c16-aa86-de50f7654a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82f8a09-f295-44d0-96a0-360a98d980ba', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1158aa52-5f49-4ba6-9413-b8b5f6161ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Creating offline snapshot 87df3631-654d-442a-bc48-44d819670065 of volume 8f5553f5-0061-477c-b25f-044f31794f45 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:57:05 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Volume volume-d82f8a09-f295-44d0-96a0-360a98d980ba (d82f8a09-f295-44d0-96a0-360a98d980ba): created successfully Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1158aa52-5f49-4ba6-9413-b8b5f6161ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Flow 'volume_create_manager' (2171a50e-ecca-498f-8e8a-27f4a3f54d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd24bc3-a864-45e1-8394-de490af1c775]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-982ac323-13c0-4d71-9cd5-6b056089b2da tempest-CreateVolumesFromImageTest-488265274 None] Created volume successfully. Sep 15 18:57:05 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 Sep 15 18:57:05 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-d82f8a09-f295-44d0-96a0-360a98d980ba-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-d82f8a09-f295-44d0-96a0-360a98d980ba-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Acquiring lock "cinder-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-quobyte-d82f8a09-f295-44d0-96a0-360a98d980ba" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-d82f8a09-f295-44d0-96a0-360a98d980ba" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Lock "cinder-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6c7adf-df1f-4d76-9633-760c41de82cf]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:05 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45" returned: 0 in 0.536s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Acquiring lock "cinder-quobyte-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:05 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 1G Sep 15 18:57:05 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[378d5af7-fdbe-418a-bb4d-e51e748d0761]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:05 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba Sep 15 18:57:05 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:05 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c Sep 15 18:57:05 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:06 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba" returned: 0 in 0.453s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:06 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba Sep 15 18:57:06 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:06 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 1G" returned: 0 in 0.509s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f5553f5-0061-477c-b25f-044f31794f45 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:06 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" returned: 0 in 0.428s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:06 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f5553f5-0061-477c-b25f-044f31794f45 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 Sep 15 18:57:06 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:06 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c Sep 15 18:57:06 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:06 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d82f8a09-f295-44d0-96a0-360a98d980ba" returned: 0 in 0.316s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-d82f8a09-f295-44d0-96a0-360a98d980ba" released by "delete_volume" :: held 0.839s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Created reservations ['d666376c-7cd9-4976-9ddc-a6da4f8d68d6', 'ddd538f5-17d6-42c8-b127-9036732939cf', 'ae8318d1-5574-4781-a5cb-5b98b30d0969', '183ba041-199b-4c19-85fe-83be52ad6715'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:06 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" returned: 0 in 0.311s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:06 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Lock "cinder-quobyte-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c" released by "delete_volume" :: held 0.817s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f5553f5-0061-477c-b25f-044f31794f45 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065" returned: 0 in 0.363s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:06 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 is being set with open permissions: ugo+rw Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:06 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 Sep 15 18:57:06 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:06 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:06 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Created reservations ['e0262a13-10e7-46ba-ac9a-91de1003bafc', '70020103-c4c6-455a-aca2-2531d1886169', '73e16309-0b29-4e00-ba6d-8d6f9c011d65', '4081e162-c057-40a7-9f47-b14455fd1a6a'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-7c6dcbf9-0e0c-4534-8582-b819828b126d-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-7c6dcbf9-0e0c-4534-8582-b819828b126d-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-quobyte-7c6dcbf9-0e0c-4534-8582-b819828b126d" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-7c6dcbf9-0e0c-4534-8582-b819828b126d" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:06 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065" returned: 0 in 0.404s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af204a3-b10f-4588-9721-66462337763b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:07 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:07 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:07 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.391s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Deleted volume successfully. Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8515be2d-b75b-4c57-9e8d-9c85fc809df1 tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-d82f8a09-f295-44d0-96a0-360a98d980ba-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:07 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.info Sep 15 18:57:07 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:07 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d Sep 15 18:57:07 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:07 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.343s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Deleted volume successfully. Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f1defde-b1cc-4323-9956-43bcf82b748b tempest-VolumeDependencyTests-967019085 None] Lock "cinder-27cc0a7f-40c8-4b8e-9d1e-a4ccacbb692c-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:07 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.info" returned: 0 in 0.302s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:07 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.info is being set with open permissions: ugo+rw Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:07 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.info Sep 15 18:57:07 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:07 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d" returned: 0 in 0.494s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:07 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d Sep 15 18:57:07 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:07 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.info" returned: 0 in 0.297s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0d576cce-f5f3-423f-8268-6c17f3c8ceba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Create snapshot completed successfully Sep 15 18:57:07 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7c6dcbf9-0e0c-4534-8582-b819828b126d" returned: 0 in 0.290s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-7c6dcbf9-0e0c-4534-8582-b819828b126d" released by "delete_volume" :: held 0.870s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=139,cinder:UPDATE=171,cinder:INSERT=53,cinder:DELETE=17 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=140,cinder:UPDATE=180,cinder:DELETE=15,cinder:INSERT=40 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Created reservations ['1542eb92-0233-4983-ba8d-3592c2df07e1', '1fa2789c-9fa4-40c3-aa7d-586c38a51280', '13002361-d6a2-440f-8937-f5e0c22c3089', 'c1c390b6-ce9d-44c8-b0cf-c97e88da9a9b'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:07 devstack sudo[101035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:07 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:08 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.277s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:08 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Deleted volume successfully. Sep 15 18:57:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9191fbc4-6682-4bce-a986-f2c1aa905f71 tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-7c6dcbf9-0e0c-4534-8582-b819828b126d-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-f74dd889-c4e9-4ed6-b737-963b063d9202-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-f74dd889-c4e9-4ed6-b737-963b063d9202-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-quobyte-f74dd889-c4e9-4ed6-b737-963b063d9202" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-f74dd889-c4e9-4ed6-b737-963b063d9202" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[15da471c-c925-4d21-bd05-a1fe2e1239f9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (5d7a2b81-3d4b-401d-bab7-ce1cf7cbff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca36e78-66e5-4c15-97ae-aa8c04e08dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca36e78-66e5-4c15-97ae-aa8c04e08dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521028534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee7f6d7-e452-4b5e-900a-438e6d722167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:09Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae411e47-ebcf-474a-993e-395783c69f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae411e47-ebcf-474a-993e-395783c69f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d926b39-f0c1-431b-ada2-04154ab5b40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:09 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202 Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d926b39-f0c1-431b-ada2-04154ab5b40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee7f6d7-e452-4b5e-900a-438e6d722167', 'volume_name': 'volume-7ee7f6d7-e452-4b5e-900a-438e6d722167', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:09 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f068b5c2-aa02-4817-af98-b53016db5b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f068b5c2-aa02-4817-af98-b53016db5b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed4869f-dd8b-4b2e-8865-384b1b168501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:09 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume 7ee7f6d7-e452-4b5e-900a-438e6d722167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee7f6d7-e452-4b5e-900a-438e6d722167', 'volume_size': 1} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521028534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee7f6d7-e452-4b5e-900a-438e6d722167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:09Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Creating volume 7ee7f6d7-e452-4b5e-900a-438e6d722167 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:09 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:09 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 1073741824 Sep 15 18:57:09 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:09 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202" returned: 0 in 0.641s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:10 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202 Sep 15 18:57:10 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (63c49c48-f759-4af9-9347-565ae4c3e1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbe0b33-4f25-4b9a-8f00-517919bbf49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bbe0b33-4f25-4b9a-8f00-517919bbf49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1068280513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c066abf0-5a1e-4d3c-95bd-c07c6680bc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:10Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c0ac2b-3e80-476a-a77b-6a65d27234af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c0ac2b-3e80-476a-a77b-6a65d27234af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ced146c-92a8-40e9-8787-1dfa05966ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ced146c-92a8-40e9-8787-1dfa05966ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c066abf0-5a1e-4d3c-95bd-c07c6680bc2c', 'volume_name': 'volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec6324e-916c-4f35-90d5-e6886fd467c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec6324e-916c-4f35-90d5-e6886fd467c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43350a9-162b-4a1c-a8f3-e2d0c9ebcfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume c066abf0-5a1e-4d3c-95bd-c07c6680bc2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c', 'volume_size': 1} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:10 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 1073741824" returned: 0 in 0.869s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:10 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f74dd889-c4e9-4ed6-b737-963b063d9202" returned: 0 in 0.440s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-f74dd889-c4e9-4ed6-b737-963b063d9202" released by "delete_volume" :: held 1.164s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:10 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 Sep 15 18:57:10 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Created reservations ['ae31e273-1ee2-4561-a69f-7f56f07d8c28', '062428f8-f490-444e-9fec-94b2059f99e1', 'eb0a7657-5d0e-4930-abaa-2ba5b1f360f3', '0103b49f-9a58-4e61-9016-03fa6ce72e58'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:10 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:10 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (04c7cb1b-c3fd-4997-9008-1e842e988bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:10 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d275422b-166b-4c58-b028-bbabae90d7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167" returned: 0 in 0.422s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1068280513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c066abf0-5a1e-4d3c-95bd-c07c6680bc2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:10Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Creating volume c066abf0-5a1e-4d3c-95bd-c07c6680bc2c {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:10 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d275422b-166b-4c58-b028-bbabae90d7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1924987470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761d72c1-0ea9-47f2-9a0f-68fdfd7570b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:11Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f229cf-f783-433f-b3da-7ce9948e6a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f229cf-f783-433f-b3da-7ce9948e6a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233b497b-4f67-41a4-bafe-1b8bff8b83ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233b497b-4f67-41a4-bafe-1b8bff8b83ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '761d72c1-0ea9-47f2-9a0f-68fdfd7570b2', 'volume_name': 'volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:10 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c 1073741824 Sep 15 18:57:10 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9952c247-1811-4edb-ae10-8246a41761b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9952c247-1811-4edb-ae10-8246a41761b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85936c11-0d14-4757-8d75-ad1a69295e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:10 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume 761d72c1-0ea9-47f2-9a0f-68fdfd7570b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2', 'volume_size': 1} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed4869f-dd8b-4b2e-8865-384b1b168501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee7f6d7-e452-4b5e-900a-438e6d722167', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30cf83c-d8b6-4109-8f22-82093a1638e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:11 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 (7ee7f6d7-e452-4b5e-900a-438e6d722167): created successfully Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d30cf83c-d8b6-4109-8f22-82093a1638e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (5d7a2b81-3d4b-401d-bab7-ce1cf7cbff48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0ed7e91e-5e90-4ac1-ad78-ad804c71181a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created volume successfully. Sep 15 18:57:11 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.461s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Deleted volume successfully. Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c7b9002-fa99-403e-9913-f7f6f233631b tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-f74dd889-c4e9-4ed6-b737-963b063d9202-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-fddcbb35-53d3-4c97-bc44-1d1aa5877bae-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (201dfa0c-a50c-4f28-8056-e0bfbbb5e4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab68e52-9ebe-4b95-8e86-e66b9fbadfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-fddcbb35-53d3-4c97-bc44-1d1aa5877bae-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab68e52-9ebe-4b95-8e86-e66b9fbadfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069849688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d589b7-b72b-46df-b0dd-eb8fc1c34d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:12Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579bdd3-9e6a-4e9f-82de-e35a837862eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3579bdd3-9e6a-4e9f-82de-e35a837862eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036399c8-a3d0-452c-80aa-a55d507454e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036399c8-a3d0-452c-80aa-a55d507454e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d589b7-b72b-46df-b0dd-eb8fc1c34d03', 'volume_name': 'volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020d92be-a546-45a1-a38b-79654ab65532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020d92be-a546-45a1-a38b-79654ab65532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:11 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fecc90-905a-417e-b514-cc7ffdbecd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:11 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume 32d589b7-b72b-46df-b0dd-eb8fc1c34d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03', 'volume_size': 1} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c 1073741824" returned: 0 in 0.932s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-quobyte-fddcbb35-53d3-4c97-bc44-1d1aa5877bae" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-fddcbb35-53d3-4c97-bc44-1d1aa5877bae" acquired by "delete_volume" :: waited 0.044s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:11 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c Sep 15 18:57:11 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8bf6ab-1e03-40d2-8fff-6a89915d6eab]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:12 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae Sep 15 18:57:12 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (8afaf610-61ae-4217-8289-2f2de0b778cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ad877f-b7fb-437a-80b6-c1f5b1022ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74ad877f-b7fb-437a-80b6-c1f5b1022ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-797780512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60949bc0-e1db-4bed-b0f4-a74151744d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:12Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c4338a-1a18-41f9-aa70-85003a090950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21c4338a-1a18-41f9-aa70-85003a090950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5404ec53-e281-43da-a425-d19e946732e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5404ec53-e281-43da-a425-d19e946732e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60949bc0-e1db-4bed-b0f4-a74151744d6b', 'volume_name': 'volume-60949bc0-e1db-4bed-b0f4-a74151744d6b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e089dc-1d6b-49f8-8772-89908c537df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e089dc-1d6b-49f8-8772-89908c537df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d87c94-29b7-4b19-b253-bd269c330257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:12 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume 60949bc0-e1db-4bed-b0f4-a74151744d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60949bc0-e1db-4bed-b0f4-a74151744d6b', 'volume_size': 1} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:12 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c" returned: 0 in 0.473s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1924987470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=761d72c1-0ea9-47f2-9a0f-68fdfd7570b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:11Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Creating volume 761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:12 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43350a9-162b-4a1c-a8f3-e2d0c9ebcfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:12 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 1073741824 Sep 15 18:57:12 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba3adb0-ea23-4b84-8881-3857176a2c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:12 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c (c066abf0-5a1e-4d3c-95bd-c07c6680bc2c): created successfully Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba3adb0-ea23-4b84-8881-3857176a2c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (63c49c48-f759-4af9-9347-565ae4c3e1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:12 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d0939ba0-e1af-4796-9764-0df849e003f6 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created volume successfully. Sep 15 18:57:12 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae" returned: 0 in 0.552s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:12 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae Sep 15 18:57:12 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:12 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fddcbb35-53d3-4c97-bc44-1d1aa5877bae" returned: 0 in 0.378s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-fddcbb35-53d3-4c97-bc44-1d1aa5877bae" released by "delete_volume" :: held 1.006s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:12 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 1073741824" returned: 0 in 0.566s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:12 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Created reservations ['b0420ffb-1dc0-438e-bac3-43d48385585f', '219f7fdb-e0a8-43c2-aaed-9d939d4c73f8', 'e53d9371-1818-4fa6-8ebd-6670e026ba57', 'c27c6c86-0ca5-4cd7-8183-53c12f47f6fd'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:13 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 Sep 15 18:57:13 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:13 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:13 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:13 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2" returned: 0 in 0.368s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1069849688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d589b7-b72b-46df-b0dd-eb8fc1c34d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:12Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Creating volume 32d589b7-b72b-46df-b0dd-eb8fc1c34d03 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:13 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85936c11-0d14-4757-8d75-ad1a69295e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b37bbae-fe67-4636-99a6-03facbc99107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:13 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 1073741824 Sep 15 18:57:13 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:13 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 (761d72c1-0ea9-47f2-9a0f-68fdfd7570b2): created successfully Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b37bbae-fe67-4636-99a6-03facbc99107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (04c7cb1b-c3fd-4997-9008-1e842e988bd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:13 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-cee213ce-eb64-440b-a448-9dca75399469 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created volume successfully. Sep 15 18:57:13 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.377s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:13 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Deleted volume successfully. Sep 15 18:57:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-72f04bc8-5894-49c0-9f8f-cc70eed2005e tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-fddcbb35-53d3-4c97-bc44-1d1aa5877bae-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-227e5346-4f89-4120-93b2-66d726ad0a5f-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-227e5346-4f89-4120-93b2-66d726ad0a5f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:14 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 1073741824" returned: 0 in 0.697s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "cinder-quobyte-227e5346-4f89-4120-93b2-66d726ad0a5f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-227e5346-4f89-4120-93b2-66d726ad0a5f" acquired by "delete_volume" :: waited 0.037s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:14 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 Sep 15 18:57:14 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b471ba00-ecd2-4369-be45-e72c23dbe777]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:14 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f Sep 15 18:57:14 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:14 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03" returned: 0 in 0.433s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.324s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-797780512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60949bc0-e1db-4bed-b0f4-a74151744d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3524d77ca669433cbbbd2c3fdfb20d33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:12Z,use_quota=True,user_id='88527e15344d41dfa8ee574baefe96bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Creating volume 60949bc0-e1db-4bed-b0f4-a74151744d6b {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:14 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:14 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b 1073741824 Sep 15 18:57:14 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fecc90-905a-417e-b514-cc7ffdbecd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901a3d09-ed27-4446-800b-0da34564c7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:14 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 (32d589b7-b72b-46df-b0dd-eb8fc1c34d03): created successfully Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901a3d09-ed27-4446-800b-0da34564c7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (201dfa0c-a50c-4f28-8056-e0bfbbb5e4ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3a90bd64-805b-4de0-8bcf-fca6a7d9d1c9 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created volume successfully. Sep 15 18:57:14 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f" returned: 0 in 0.532s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:14 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f Sep 15 18:57:14 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:15 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-227e5346-4f89-4120-93b2-66d726ad0a5f" returned: 0 in 0.323s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-quobyte-227e5346-4f89-4120-93b2-66d726ad0a5f" released by "delete_volume" :: held 0.934s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Created reservations ['c546a311-2aa9-4cb6-995a-efc54447c3e9', 'f7b3e185-8bd6-4ee2-8f6c-c1f2274844eb', 'e2d8459d-9a57-4665-9586-b73028567473', '37f08074-ea46-4282-a927-5cc64799284e'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:15 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b 1073741824" returned: 0 in 0.643s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:15 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b Sep 15 18:57:15 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:15 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:15 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:15 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.335s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Deleted volume successfully. Sep 15 18:57:15 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b" returned: 0 in 0.407s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-238e524f-fba6-4f88-976e-542d9325805a tempest-CreateVolumesFromImageTest-488265274 None] Lock "cinder-227e5346-4f89-4120-93b2-66d726ad0a5f-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d87c94-29b7-4b19-b253-bd269c330257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60949bc0-e1db-4bed-b0f4-a74151744d6b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d2677e-36c3-402a-8a3b-16549bed9a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:15 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Volume volume-60949bc0-e1db-4bed-b0f4-a74151744d6b (60949bc0-e1db-4bed-b0f4-a74151744d6b): created successfully Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d2677e-36c3-402a-8a3b-16549bed9a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:15 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Flow 'volume_create_manager' (8afaf610-61ae-4217-8289-2f2de0b778cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c6f4a77a-50c5-44f0-b491-b453267df4ad tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created volume successfully. Sep 15 18:57:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-60949bc0-e1db-4bed-b0f4-a74151744d6b-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-60949bc0-e1db-4bed-b0f4-a74151744d6b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-quobyte-60949bc0-e1db-4bed-b0f4-a74151744d6b" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-60949bc0-e1db-4bed-b0f4-a74151744d6b" acquired by "delete_volume" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:17 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c79ba35-daab-488a-b99e-dfca3a7aa54f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:17 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b Sep 15 18:57:17 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:17 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b" returned: 0 in 0.486s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:17 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b Sep 15 18:57:17 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:17 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-60949bc0-e1db-4bed-b0f4-a74151744d6b" returned: 0 in 0.354s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-60949bc0-e1db-4bed-b0f4-a74151744d6b" released by "delete_volume" :: held 0.920s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created reservations ['3341d14f-7d18-4b96-8ff6-77ec5522d994', '0fa265dd-fc27-47e0-a1ee-e16e64ba12db', 'f9ede3ca-32ac-4a57-a910-f90620817eb8', 'fdf41d39-1c52-47b4-934e-e5d2e20526d2'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:18 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:18 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:18 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.335s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:18 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Deleted volume successfully. Sep 15 18:57:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a672e077-9bd5-4004-811f-7a6302a9ca12 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-60949bc0-e1db-4bed-b0f4-a74151744d6b-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-32d589b7-b72b-46df-b0dd-eb8fc1c34d03-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-32d589b7-b72b-46df-b0dd-eb8fc1c34d03-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-quobyte-32d589b7-b72b-46df-b0dd-eb8fc1c34d03" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-32d589b7-b72b-46df-b0dd-eb8fc1c34d03" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:19 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8b46bb-23f2-4873-80cf-a89b833cb368]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:19 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 Sep 15 18:57:19 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:19 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03" returned: 0 in 0.555s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:19 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03 Sep 15 18:57:19 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:20 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-32d589b7-b72b-46df-b0dd-eb8fc1c34d03" returned: 0 in 0.308s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-32d589b7-b72b-46df-b0dd-eb8fc1c34d03" released by "delete_volume" :: held 0.919s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created reservations ['13989956-4897-45bb-8f98-7a1a377ea141', '9e995549-403d-40b7-92c6-33a2454c3d26', '80f70b31-92b9-46d4-abed-c4757f4a6d17', '8db7f4af-919d-4c46-9c64-0d52c04d2810'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:20 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:20 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-quobyte-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d564b-9361-4f67-bbe9-ff912aba8412]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:20 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 Sep 15 18:57:20 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:20 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.462s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:20 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Deleted volume successfully. Sep 15 18:57:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-109b3556-3f72-4fac-b50f-be1a9598a13f tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-32d589b7-b72b-46df-b0dd-eb8fc1c34d03-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:21 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Flow 'volume_create_manager' (c2056f36-0609-4ef1-b375-05e0074fc317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35cfcdef-e9b5-467b-8884-e8add389e13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2" returned: 0 in 0.626s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35cfcdef-e9b5-467b-8884-e8add389e13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479f131d-f24b-4cb1-b2f9-248775f6885d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b9e454cc72404da75a60a1a82bbae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:21Z,use_quota=True,user_id='7662acfbfa534b1a84994f2c9decccda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:21 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2 Sep 15 18:57:21 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bdb7e00-1d5c-4c81-bf81-5ba6103e2e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bdb7e00-1d5c-4c81-bf81-5ba6103e2e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150a52c1-020e-4dc9-9434-72b149185389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150a52c1-020e-4dc9-9434-72b149185389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '479f131d-f24b-4cb1-b2f9-248775f6885d', 'volume_name': 'volume-479f131d-f24b-4cb1-b2f9-248775f6885d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f24a43-b400-49a1-87fb-e93b20ff5535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f24a43-b400-49a1-87fb-e93b20ff5535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bab547b-05f9-4ae9-9301-ee43bbc2f139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:21 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Volume 479f131d-f24b-4cb1-b2f9-248775f6885d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-479f131d-f24b-4cb1-b2f9-248775f6885d', 'volume_size': 1} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=479f131d-f24b-4cb1-b2f9-248775f6885d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b9e454cc72404da75a60a1a82bbae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:21Z,use_quota=True,user_id='7662acfbfa534b1a84994f2c9decccda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Creating volume 479f131d-f24b-4cb1-b2f9-248775f6885d {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:21 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:21 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d 1073741824 Sep 15 18:57:21 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:21 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2" returned: 0 in 0.306s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2" released by "delete_volume" :: held 0.999s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created reservations ['e36863b3-43a7-433a-a9e0-da297f5eedda', '58fcb39f-a354-4792-8cf6-ba44ceee32d7', '15cc24c6-2c0d-4b26-b92e-28efccf7ce7c', 'eff96468-3d60-4570-a572-2db2d8ebe99f'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:21 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:21 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:21 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d 1073741824" returned: 0 in 0.599s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:22 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d Sep 15 18:57:22 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:22 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.316s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:22 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Deleted volume successfully. Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dd9c8660-35dd-4e2f-b3a6-8b1e2c41aa9a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-761d72c1-0ea9-47f2-9a0f-68fdfd7570b2-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:22 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d" returned: 0 in 0.282s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bab547b-05f9-4ae9-9301-ee43bbc2f139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-479f131d-f24b-4cb1-b2f9-248775f6885d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bb4c89-95d4-47b0-94c7-6376cd911b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:22 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Volume volume-479f131d-f24b-4cb1-b2f9-248775f6885d (479f131d-f24b-4cb1-b2f9-248775f6885d): created successfully Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52bb4c89-95d4-47b0-94c7-6376cd911b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Flow 'volume_create_manager' (c2056f36-0609-4ef1-b375-05e0074fc317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:22 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-fa423647-bd34-4387-858d-339013b1353e tempest-CinderUnicodeTest-759499639 None] Created volume successfully. Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-quobyte-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87f15fd-32e3-4560-85cf-3b6b8fb34106]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:23 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c Sep 15 18:57:23 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:23 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c" returned: 0 in 0.515s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:23 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c Sep 15 18:57:23 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:23 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c" returned: 0 in 0.407s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:23 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c" released by "delete_volume" :: held 0.981s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:23 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created reservations ['56e7ccc9-4602-4466-8233-45c99ab2d0fb', 'f10248be-4cc1-4795-ac4b-6f07e7ca8c2a', '3763145b-c658-47c3-bb83-b62e9f040275', 'e5543795-d4f4-4d81-b66c-a54d2c0363f6'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Flow 'volume_create_manager' (986212d3-e36d-4e02-bda2-24823a10cea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce29421-0f6c-4e0f-8c8f-1bfc13499b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce29421-0f6c-4e0f-8c8f-1bfc13499b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1067184716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b36835-33c6-46b2-8d10-4d2ccede4364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b9e454cc72404da75a60a1a82bbae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:24Z,use_quota=True,user_id='7662acfbfa534b1a84994f2c9decccda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168c0d12-0f05-42b7-95c6-0163b5bc76bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168c0d12-0f05-42b7-95c6-0163b5bc76bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68c4396-e8b3-4dee-aae2-6583c8bcec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68c4396-e8b3-4dee-aae2-6583c8bcec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39b36835-33c6-46b2-8d10-4d2ccede4364', 'volume_name': 'volume-39b36835-33c6-46b2-8d10-4d2ccede4364', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a295e4f9-08db-4e99-a118-6350855de565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a295e4f9-08db-4e99-a118-6350855de565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4365c8de-ba4a-4bf9-b4de-b63d7b746a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:24 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Volume 39b36835-33c6-46b2-8d10-4d2ccede4364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39b36835-33c6-46b2-8d10-4d2ccede4364', 'volume_size': 1} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1067184716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b36835-33c6-46b2-8d10-4d2ccede4364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b9e454cc72404da75a60a1a82bbae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:24Z,use_quota=True,user_id='7662acfbfa534b1a84994f2c9decccda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Creating volume 39b36835-33c6-46b2-8d10-4d2ccede4364 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:24 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:24 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 1073741824 Sep 15 18:57:24 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:24 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:24 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:24 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.270s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:24 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Deleted volume successfully. Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d960c0d2-b43b-448f-86e4-026decbaa907 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-c066abf0-5a1e-4d3c-95bd-c07c6680bc2c-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:24 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 1073741824" returned: 0 in 0.567s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:24 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 Sep 15 18:57:24 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:25 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364" returned: 0 in 0.290s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4365c8de-ba4a-4bf9-b4de-b63d7b746a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b36835-33c6-46b2-8d10-4d2ccede4364', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9b5c29-1823-40c2-84f4-9a427a2bdc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-7ee7f6d7-e452-4b5e-900a-438e6d722167-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:25 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Volume volume-39b36835-33c6-46b2-8d10-4d2ccede4364 (39b36835-33c6-46b2-8d10-4d2ccede4364): created successfully Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d9b5c29-1823-40c2-84f4-9a427a2bdc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Flow 'volume_create_manager' (986212d3-e36d-4e02-bda2-24823a10cea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-7ee7f6d7-e452-4b5e-900a-438e6d722167-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ab56bc23-3fbb-456c-a660-859a87a77c5e tempest-CinderUnicodeTest-759499639 None] Created volume successfully. Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-quobyte-7ee7f6d7-e452-4b5e-900a-438e6d722167" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-7ee7f6d7-e452-4b5e-900a-438e6d722167" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca31c37-696b-4b98-bffc-3e9cb105fc8d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:25 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 Sep 15 18:57:25 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Flow 'volume_create_manager' (a7efce5f-46b9-4c58-9724-3bf138719b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f9801b-0ec2-455b-909e-d41c7e02d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f9801b-0ec2-455b-909e-d41c7e02d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1324332946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0cfbd3-0431-46db-8afe-b1a4efe74010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5da855f9df0480db1e285823bcbcda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:25Z,use_quota=True,user_id='51ca8de1fc5146b3b1f7562baf988009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041b15be-6dc7-475e-887f-941a385980fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041b15be-6dc7-475e-887f-941a385980fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44d68df-9783-44ab-9245-be473825f9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 18:57:25 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167" returned: 0 in 0.555s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:25 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167 Sep 15 18:57:25 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c44d68df-9783-44ab-9245-be473825f9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cf0cfbd3-0431-46db-8afe-b1a4efe74010', 'volume_name': 'volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcd81a4-6544-415b-8553-09f281c613fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcd81a4-6544-415b-8553-09f281c613fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cc6797-b2f8-4db4-b8c4-57cbe68b58f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:25 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Volume cf0cfbd3-0431-46db-8afe-b1a4efe74010: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 18:57:25 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Trying to clone cf0cfbd3-0431-46db-8afe-b1a4efe74010 from image cb9e9155-abe1-4ceb-8a92-39c0a579534a at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 18:57:26 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7ee7f6d7-e452-4b5e-900a-438e6d722167" returned: 0 in 0.312s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-7ee7f6d7-e452-4b5e-900a-438e6d722167" released by "delete_volume" :: held 0.931s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created reservations ['eb6bdfc9-f39f-46d8-b61a-82e3913a3cbb', 'bd234e43-c97b-4c12-abb8-540abd11f0b2', 'a0c42a63-6f3e-47fc-980a-f4ce3f947e11', '2c78ff7b-a5db-45e0-b29c-d01be5df3108'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 18:57:26 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Image download 20.69 MB at 20.69 MB/s Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[053cae69-56cd-4ece-9622-2adea5919e67]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:26 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:26 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Creating offline snapshot 9f3a0ce3-5a7b-453e-865d-92fb3de6a453 of volume 39b36835-33c6-46b2-8d10-4d2ccede4364 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c7d1d2-cd2e-4f9f-9fe4-e0371bcaa5af]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:26 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD Sep 15 18:57:26 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:26 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 Sep 15 18:57:26 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:26 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.305s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:26 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Deleted volume successfully. Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5d0b37e5-eb93-4a33-b1ec-a7e82cfd77ba tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-7ee7f6d7-e452-4b5e-900a-438e6d722167-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:26 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a is fetched for user 51ca8de1fc5146b3b1f7562baf988009. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 18:57:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c083832-75ac-4b5e-8518-ae515e8834f6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:27 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364" returned: 0 in 0.472s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:27 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD Sep 15 18:57:27 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:27 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 1G Sep 15 18:57:27 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:27 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-87df3631-654d-442a-bc48-44d819670065-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-87df3631-654d-442a-bc48-44d819670065-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-quobyte-8f5553f5-0061-477c-b25f-044f31794f45" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-8f5553f5-0061-477c-b25f-044f31794f45" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-quobyte-87df3631-654d-442a-bc48-44d819670065" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-87df3631-654d-442a-bc48-44d819670065" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Deleting offline snapshot 87df3631-654d-442a-bc48-44d819670065 of volume 8f5553f5-0061-477c-b25f-044f31794f45 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] snapshot_file for this snap is: volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[519d17b4-5433-4c71-8cc4-da3e08cb7fa6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:27 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 1G" returned: 0 in 0.524s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39b36835-33c6-46b2-8d10-4d2ccede4364 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:27 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39b36835-33c6-46b2-8d10-4d2ccede4364 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 Sep 15 18:57:27 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:27 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 Sep 15 18:57:27 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:27 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39b36835-33c6-46b2-8d10-4d2ccede4364 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453" returned: 0 in 0.317s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:27 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 is being set with open permissions: ugo+rw Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:27 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065" returned: 0 in 0.403s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f5553f5-0061-477c-b25f-044f31794f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:57:27 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 Sep 15 18:57:27 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[854dfca1-a392-4389-9482-5b59a6102229]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:28 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 Sep 15 18:57:28 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:28 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453" returned: 0 in 0.307s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:28 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.info Sep 15 18:57:28 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:28 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45" returned: 0 in 0.440s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:28 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 Sep 15 18:57:28 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:28 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.info" returned: 0 in 0.348s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:28 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.info is being set with open permissions: ugo+rw Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:28 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.info Sep 15 18:57:28 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:28 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065" returned: 0 in 0.445s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:28 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.info" returned: 0 in 0.302s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:28 devstack sudo[101250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065 Sep 15 18:57:28 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1324332946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0cfbd3-0431-46db-8afe-b1a4efe74010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5da855f9df0480db1e285823bcbcda5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:25Z,use_quota=True,user_id='51ca8de1fc5146b3b1f7562baf988009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Creating volume cf0cfbd3-0431-46db-8afe-b1a4efe74010 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:28 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:29 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 1073741824 Sep 15 18:57:29 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bf4bebf0-9c23-4b80-9b54-65dea6ca4a00 tempest-CinderUnicodeTest-759499639 None] Create snapshot completed successfully Sep 15 18:57:29 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45.87df3631-654d-442a-bc48-44d819670065" returned: 0 in 0.302s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-87df3631-654d-442a-bc48-44d819670065" released by "_delete_snapshot" :: held 1.770s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-8f5553f5-0061-477c-b25f-044f31794f45" released by "delete_snapshot" :: held 1.816s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created reservations ['838a68d7-4ee3-4d00-a144-d074216f0f88', '476a8bd1-68c6-4a32-bf0d-9a2d87b2001f', 'd586315d-f386-4bfc-9e64-ca1df145f10b', '75839c27-31f6-417a-bfdb-1b14053cf767'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Delete snapshot completed successfully. Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-225d7fb7-0ab9-48db-a4bc-6f91060c5a5a tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-87df3631-654d-442a-bc48-44d819670065-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:29 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 1073741824" returned: 0 in 0.556s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-8f5553f5-0061-477c-b25f-044f31794f45-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:29 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 Sep 15 18:57:29 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-8f5553f5-0061-477c-b25f-044f31794f45-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "cinder-quobyte-8f5553f5-0061-477c-b25f-044f31794f45" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-8f5553f5-0061-477c-b25f-044f31794f45" acquired by "delete_volume" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Acquiring lock "cinder-9f3a0ce3-5a7b-453e-865d-92fb3de6a453-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fee9178-9942-486f-968d-84282bf2a665]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-9f3a0ce3-5a7b-453e-865d-92fb3de6a453-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Acquiring lock "cinder-quobyte-39b36835-33c6-46b2-8d10-4d2ccede4364" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-quobyte-39b36835-33c6-46b2-8d10-4d2ccede4364" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Acquiring lock "cinder-quobyte-9f3a0ce3-5a7b-453e-865d-92fb3de6a453" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-quobyte-9f3a0ce3-5a7b-453e-865d-92fb3de6a453" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Deleting offline snapshot 9f3a0ce3-5a7b-453e-865d-92fb3de6a453 of volume 39b36835-33c6-46b2-8d10-4d2ccede4364 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] snapshot_file for this snap is: volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[798eb435-8bbb-49d7-a147-d19d43597378]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:29 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:29 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 Sep 15 18:57:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010" returned: 0 in 0.412s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:30 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Attempting download of cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume cf0cfbd3-0431-46db-8afe-b1a4efe74010. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bb15c8-9c7c-4590-b793-7f3b15e14d44]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_lvxtabyk {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:30 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 Sep 15 18:57:30 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:30 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_lvxtabyk Sep 15 18:57:30 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:30 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45" returned: 0 in 0.494s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:30 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45 Sep 15 18:57:30 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:30 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453" returned: 0 in 0.536s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39b36835-33c6-46b2-8d10-4d2ccede4364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:57:30 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_lvxtabyk" returned: 0 in 0.399s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_lvxtabyk {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aabd17-1cfa-476a-8e09-934ccdda2425]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:30 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-8f5553f5-0061-477c-b25f-044f31794f45" returned: 0 in 0.312s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-quobyte-8f5553f5-0061-477c-b25f-044f31794f45" released by "delete_volume" :: held 0.927s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:30 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_lvxtabyk Sep 15 18:57:30 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:30 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 Sep 15 18:57:30 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Created reservations ['2d7a0e3a-e716-4c6e-b310-2777a1a5e931', '649838c5-2e6e-429a-a951-c58d1e15ee50', '981bc733-e9a3-495c-a9f7-66f299b122c1', '06e013d7-04e4-4a1f-baf1-6ff95e707cd2'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:31 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:31 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:31 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_lvxtabyk" returned: 1 in 0.570s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb9e9155-abe1-4ceb-8a92-39c0a579534a_lvxtabyk' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b7a306-6d11-4b88-804a-7a533535c6dd]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:31 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364" returned: 0 in 0.593s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:31 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 Sep 15 18:57:31 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:31 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD Sep 15 18:57:31 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:31 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.318s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Deleted volume successfully. Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b7ad2718-fbc4-4cb4-9c35-9a912c257a40 tempest-CreateVolumesFromSnapshotTest-1113042338 None] Lock "cinder-8f5553f5-0061-477c-b25f-044f31794f45-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:31 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] cb9e9155-abe1-4ceb-8a92-39c0a579534a was qcow2, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:31 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 Sep 15 18:57:31 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:31 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453" returned: 0 in 0.468s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:31 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453 Sep 15 18:57:31 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:31 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364.9f3a0ce3-5a7b-453e-865d-92fb3de6a453" returned: 0 in 0.282s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-quobyte-9f3a0ce3-5a7b-453e-865d-92fb3de6a453" released by "_delete_snapshot" :: held 2.042s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-quobyte-39b36835-33c6-46b2-8d10-4d2ccede4364" released by "delete_snapshot" :: held 2.089s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:32 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Created reservations ['a2a7a335-54a6-4a74-8608-78c6a4b3249f', '4901e9c7-317b-4236-86bf-698ddc391045', '167728e6-08e1-4cab-9c03-a5f1d1ab8856', '5c1a1404-6a75-49b9-8e70-4dbfd2d81c34'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:32 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Delete snapshot completed successfully. Sep 15 18:57:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cf7aedfe-880c-4d3d-ac61-1f1801a74a73 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-9f3a0ce3-5a7b-453e-865d-92fb3de6a453-delete_snapshot" released by "delete_snapshot" :: held 2.335s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Acquiring lock "cinder-39b36835-33c6-46b2-8d10-4d2ccede4364-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Lock "cinder-39b36835-33c6-46b2-8d10-4d2ccede4364-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Acquiring lock "cinder-quobyte-39b36835-33c6-46b2-8d10-4d2ccede4364" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Lock "cinder-quobyte-39b36835-33c6-46b2-8d10-4d2ccede4364" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:33 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3816dbd-b96b-4d2b-96b0-5bd63f2412bb]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:33 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 Sep 15 18:57:33 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:33 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364" returned: 0 in 0.548s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:33 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364 Sep 15 18:57:33 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:34 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010" returned: 0 in 2.640s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb9e9155-abe1-4ceb-8a92-39c0a579534a_8kq30gtbdevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:57:34 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Converted 112.00 MB image at 42.40 MB/s Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:34 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 1G Sep 15 18:57:34 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:34 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-39b36835-33c6-46b2-8d10-4d2ccede4364" returned: 0 in 0.326s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Lock "cinder-quobyte-39b36835-33c6-46b2-8d10-4d2ccede4364" released by "delete_volume" :: held 0.982s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Created reservations ['b42ef2c2-0f4f-4924-b430-a3b43ea9c5bd', '90799eb7-d40e-427c-b579-89ccdb8918bb', 'ae0a35dc-28ba-462f-844d-7cb18e6cdaf3', '7fe800da-cc9d-4e17-a554-4da9a106f96d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:34 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:34 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:34 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 1G" returned: 0 in 0.464s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Downloaded image cb9e9155-abe1-4ceb-8a92-39c0a579534a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}])) to volume cf0cfbd3-0431-46db-8afe-b1a4efe74010 successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Temporary image cb9e9155-abe1-4ceb-8a92-39c0a579534a for user 51ca8de1fc5146b3b1f7562baf988009 is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Marking volume cf0cfbd3-0431-46db-8afe-b1a4efe74010 as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Copying metadata from image cb9e9155-abe1-4ceb-8a92-39c0a579534a to cf0cfbd3-0431-46db-8afe-b1a4efe74010. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Creating volume glance metadata for volume cf0cfbd3-0431-46db-8afe-b1a4efe74010 backed by image cb9e9155-abe1-4ceb-8a92-39c0a579534a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 18:57:34 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cc6797-b2f8-4db4-b8c4-57cbe68b58f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010', 'volume_size': 1, 'image_id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1b3a038543394f96aeb766395aacc2b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cb9e9155-abe1-4ceb-8a92-39c0a579534a', 'created_at': datetime.datetime(2026, 9, 15, 16, 38, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 38, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb9e9155-abe1-4ceb-8a92-39c0a579534a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118417e4-c521-4929-baf6-db1f5e8abcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.284s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:34 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Deleted volume successfully. Sep 15 18:57:34 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Volume volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 (cf0cfbd3-0431-46db-8afe-b1a4efe74010): created successfully Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (118417e4-c521-4929-baf6-db1f5e8abcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Flow 'volume_create_manager' (a7efce5f-46b9-4c58-9724-3bf138719b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:34 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-fbba1ad2-3540-4fb0-84ff-d52264231ce1 tempest-VolumesImageMetadata-855471479 None] Created volume successfully. Sep 15 18:57:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5112662d-6fb7-4a8d-a8b7-0f86e5a5997a tempest-CinderUnicodeTest-759499639 None] Lock "cinder-39b36835-33c6-46b2-8d10-4d2ccede4364-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Acquiring lock "cinder-479f131d-f24b-4cb1-b2f9-248775f6885d-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-479f131d-f24b-4cb1-b2f9-248775f6885d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Acquiring lock "cinder-quobyte-479f131d-f24b-4cb1-b2f9-248775f6885d" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-quobyte-479f131d-f24b-4cb1-b2f9-248775f6885d" acquired by "delete_volume" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:35 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66c9274-b6d5-4c02-938f-8ec6116a8975]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:35 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d Sep 15 18:57:35 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Acquiring lock "cinder-cf0cfbd3-0431-46db-8afe-b1a4efe74010-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:36 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d" returned: 0 in 0.465s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Lock "cinder-cf0cfbd3-0431-46db-8afe-b1a4efe74010-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:36 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d Sep 15 18:57:36 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Acquiring lock "cinder-quobyte-cf0cfbd3-0431-46db-8afe-b1a4efe74010" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Lock "cinder-quobyte-cf0cfbd3-0431-46db-8afe-b1a4efe74010" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e154b5a3-e38c-478b-a1f7-567c236d6ce8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:36 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 Sep 15 18:57:36 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:36 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-479f131d-f24b-4cb1-b2f9-248775f6885d" returned: 0 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-quobyte-479f131d-f24b-4cb1-b2f9-248775f6885d" released by "delete_volume" :: held 0.916s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Created reservations ['17d4d11b-137f-47ef-862d-f368bfca71c0', '4b8d2207-af5c-413d-91ec-0db556d228a9', '0dbda51b-fa32-4034-a229-11768a89e460', 'cbf21dcc-db06-4d91-ad42-c29ef3dd1fc9'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:36 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:36 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:36 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010" returned: 0 in 0.589s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:36 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010 Sep 15 18:57:36 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:37 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.327s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Deleted volume successfully. Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6fd3acb6-c988-4011-971a-1b1c51084c46 tempest-CinderUnicodeTest-759499639 None] Lock "cinder-479f131d-f24b-4cb1-b2f9-248775f6885d-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:37 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cf0cfbd3-0431-46db-8afe-b1a4efe74010" returned: 0 in 0.313s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Lock "cinder-quobyte-cf0cfbd3-0431-46db-8afe-b1a4efe74010" released by "delete_volume" :: held 0.965s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Created reservations ['6569f2d2-b83e-4507-a44d-85acf755575d', 'a11cb3a9-6888-41ae-96b9-501431109e40', 'f8cd837a-3fc9-4072-92ab-7359da5fef7a', '7a1aeffd-1d6b-46bc-809b-049a94571b53'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:37 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:37 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:37 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.252s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Deleted volume successfully. Sep 15 18:57:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-06c7a677-f012-4c99-bfdf-09248a86b3df tempest-VolumesImageMetadata-855471479 None] Lock "cinder-cf0cfbd3-0431-46db-8afe-b1a4efe74010-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:38 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Flow 'volume_create_manager' (3f264381-fa41-4de6-86cc-b13d23db21d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e6dfdb-c8ec-4f25-9a61-4edc3b8e84d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5e6dfdb-c8ec-4f25-9a61-4edc3b8e84d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1936715a-f367-4a48-8aa8-e0bbe5b292a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500ac9890154b1ea1cbb281f45ae8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:39Z,use_quota=True,user_id='33c292a56bc34b82b0af676819dca58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5bcb54-e6f1-4a67-a403-769d412ffbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5bcb54-e6f1-4a67-a403-769d412ffbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c91025-1cdf-4d75-b6ba-be98999ea4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:38 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 18:57:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c91025-1cdf-4d75-b6ba-be98999ea4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1936715a-f367-4a48-8aa8-e0bbe5b292a9', 'volume_name': 'volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9', 'volume_size': 1, 'image_id': 'dac4836f-3b46-4131-8a75-f82edac8ea41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dac4836f-3b46-4131-8a75-f82edac8ea41', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9b989d0186542ca79989eb6bf1a6dc9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6500ac9890154b1ea1cbb281f45ae8b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e19d0d925b68ac0fea588c3483c12c842c8146e070f01dea54d46f86125871db67aa41f61d68184bae3ffc638bd7da114634bb793356e6cb701122165949297', 'id': 'dac4836f-3b46-4131-8a75-f82edac8ea41', 'created_at': datetime.datetime(2026, 9, 15, 16, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dac4836f-3b46-4131-8a75-f82edac8ea41/file', 'properties': {}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8da3ff3-f6a3-4cec-872a-c6c0661a4284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8da3ff3-f6a3-4cec-872a-c6c0661a4284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996559c7-00b8-4909-afaf-72238c0e0188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:39 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Volume 1936715a-f367-4a48-8aa8-e0bbe5b292a9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9', 'volume_size': 1, 'image_id': 'dac4836f-3b46-4131-8a75-f82edac8ea41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dac4836f-3b46-4131-8a75-f82edac8ea41', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9b989d0186542ca79989eb6bf1a6dc9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6500ac9890154b1ea1cbb281f45ae8b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e19d0d925b68ac0fea588c3483c12c842c8146e070f01dea54d46f86125871db67aa41f61d68184bae3ffc638bd7da114634bb793356e6cb701122165949297', 'id': 'dac4836f-3b46-4131-8a75-f82edac8ea41', 'created_at': datetime.datetime(2026, 9, 15, 16, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dac4836f-3b46-4131-8a75-f82edac8ea41/file', 'properties': {}}, 'image_service': } Sep 15 18:57:39 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Trying to clone 1936715a-f367-4a48-8aa8-e0bbe5b292a9 from image dac4836f-3b46-4131-8a75-f82edac8ea41 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dac4836f-3b46-4131-8a75-f82edac8ea41', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 18:57:39 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 18:57:39 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Image download 0.00 MB at 0.00 MB/s Sep 15 18:57:39 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb95c1-73c6-4de2-b023-01d159b3c2f6]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:39 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD Sep 15 18:57:39 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:40 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:40 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD Sep 15 18:57:40 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:40 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD" returned: 1 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:57:40 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Temporary image dac4836f-3b46-4131-8a75-f82edac8ea41 is fetched for user 33c292a56bc34b82b0af676819dca58c. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 18:57:40 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4cc9b1-13ae-4b2f-b7c3-b6d4262d1029]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:40 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD Sep 15 18:57:40 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:40 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:41 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD Sep 15 18:57:41 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:41 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD" returned: 1 in 0.446s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1936715a-f367-4a48-8aa8-e0bbe5b292a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6500ac9890154b1ea1cbb281f45ae8b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:39Z,use_quota=True,user_id='33c292a56bc34b82b0af676819dca58c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Creating volume 1936715a-f367-4a48-8aa8-e0bbe5b292a9 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:41 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:41 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 1073741824 Sep 15 18:57:41 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:42 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 1073741824" returned: 0 in 0.823s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:42 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 Sep 15 18:57:42 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:42 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9" returned: 0 in 0.359s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:42 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Attempting download of dac4836f-3b46-4131-8a75-f82edac8ea41 ((None, [{'url': 'file:///opt/stack/data/glance/images/dac4836f-3b46-4131-8a75-f82edac8ea41', 'metadata': {}}])) to volume 1936715a-f367-4a48-8aa8-e0bbe5b292a9. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 18:57:42 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[695e25c1-f458-42d3-878c-0f593bbf5f2f]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dac4836f-3b46-4131-8a75-f82edac8ea41_cz7e0xmf {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:43 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dac4836f-3b46-4131-8a75-f82edac8ea41_cz7e0xmf Sep 15 18:57:43 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:43 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dac4836f-3b46-4131-8a75-f82edac8ea41_cz7e0xmf" returned: 0 in 0.579s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dac4836f-3b46-4131-8a75-f82edac8ea41_cz7e0xmf {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:43 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dac4836f-3b46-4131-8a75-f82edac8ea41_cz7e0xmf Sep 15 18:57:43 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:43 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dac4836f-3b46-4131-8a75-f82edac8ea41_cz7e0xmf" returned: 1 in 0.530s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dac4836f-3b46-4131-8a75-f82edac8ea41_cz7e0xmf' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:57:43 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e640c97-feb0-4d3a-91a2-0de80d08c371]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:44 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD Sep 15 18:57:44 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:44 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:44 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD Sep 15 18:57:44 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:44 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD" returned: 1 in 0.418s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:57:44 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] dac4836f-3b46-4131-8a75-f82edac8ea41 was raw, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 18:57:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:44 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 Sep 15 18:57:44 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Flow 'volume_create_manager' (238e98a8-d6e2-42ed-b612-2a398424bddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87eeaf07-0104-4875-a34c-018426f71a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87eeaf07-0104-4875-a34c-018426f71a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1205659032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cb8e7a-5daa-4118-8db0-049fb7a520b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2dc1529fc0b423097708227c0c9169c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:45Z,use_quota=True,user_id='141ed66e9a0e4499b4454394a3c3fb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70176464-20d7-41bc-8895-8892839100a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70176464-20d7-41bc-8895-8892839100a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1ffdfa-f479-4b83-8198-838744e08a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1ffdfa-f479-4b83-8198-838744e08a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25cb8e7a-5daa-4118-8db0-049fb7a520b6', 'volume_name': 'volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953a3aea-ddb1-4a21-8089-31858c4432b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953a3aea-ddb1-4a21-8089-31858c4432b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cced4520-394b-4959-9e63-37e05821b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:45 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Volume 25cb8e7a-5daa-4118-8db0-049fb7a520b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6', 'volume_size': 1} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1205659032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25cb8e7a-5daa-4118-8db0-049fb7a520b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2dc1529fc0b423097708227c0c9169c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:45Z,use_quota=True,user_id='141ed66e9a0e4499b4454394a3c3fb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Creating volume 25cb8e7a-5daa-4118-8db0-049fb7a520b6 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:45 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:45 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 1073741824 Sep 15 18:57:45 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:45 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9" returned: 0 in 0.678s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dac4836f-3b46-4131-8a75-f82edac8ea41_k9hqiro0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:57:45 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Converted 0.00 MB image at 0.00 MB/s Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:45 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 1G Sep 15 18:57:45 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:45 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:45 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:45 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 1G" returned: 0 in 0.425s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Downloaded image dac4836f-3b46-4131-8a75-f82edac8ea41 ((None, [{'url': 'file:///opt/stack/data/glance/images/dac4836f-3b46-4131-8a75-f82edac8ea41', 'metadata': {}}])) to volume 1936715a-f367-4a48-8aa8-e0bbe5b292a9 successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Temporary image dac4836f-3b46-4131-8a75-f82edac8ea41 for user 33c292a56bc34b82b0af676819dca58c is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Marking volume 1936715a-f367-4a48-8aa8-e0bbe5b292a9 as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Copying metadata from image dac4836f-3b46-4131-8a75-f82edac8ea41 to 1936715a-f367-4a48-8aa8-e0bbe5b292a9. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Creating volume glance metadata for volume 1936715a-f367-4a48-8aa8-e0bbe5b292a9 backed by image dac4836f-3b46-4131-8a75-f82edac8ea41 with: {'image_id': 'dac4836f-3b46-4131-8a75-f82edac8ea41', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a9b989d0186542ca79989eb6bf1a6dc9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 18:57:45 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 1073741824" returned: 0 in 0.607s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996559c7-00b8-4909-afaf-72238c0e0188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9', 'volume_size': 1, 'image_id': 'dac4836f-3b46-4131-8a75-f82edac8ea41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dac4836f-3b46-4131-8a75-f82edac8ea41', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a9b989d0186542ca79989eb6bf1a6dc9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6500ac9890154b1ea1cbb281f45ae8b6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e19d0d925b68ac0fea588c3483c12c842c8146e070f01dea54d46f86125871db67aa41f61d68184bae3ffc638bd7da114634bb793356e6cb701122165949297', 'id': 'dac4836f-3b46-4131-8a75-f82edac8ea41', 'created_at': datetime.datetime(2026, 9, 15, 16, 57, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 57, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dac4836f-3b46-4131-8a75-f82edac8ea41/file', 'properties': {}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38018ef-6103-40a5-9616-c859d7044d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:46 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 Sep 15 18:57:46 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:46 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Volume volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 (1936715a-f367-4a48-8aa8-e0bbe5b292a9): created successfully Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38018ef-6103-40a5-9616-c859d7044d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Flow 'volume_create_manager' (3f264381-fa41-4de6-86cc-b13d23db21d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a5d9dfcb-22d6-4a65-866a-df13e3da9354 tempest-VolumeImageDependencyTests-539263011 None] Created volume successfully. Sep 15 18:57:46 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.405s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:57:46 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6" returned: 0 in 0.485s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cced4520-394b-4959-9e63-37e05821b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b9004e-dd4a-4e4b-89f5-e3967047f4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:46 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Volume volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 (25cb8e7a-5daa-4118-8db0-049fb7a520b6): created successfully Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b9004e-dd4a-4e4b-89f5-e3967047f4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Flow 'volume_create_manager' (238e98a8-d6e2-42ed-b612-2a398424bddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Acquiring lock "cinder-1936715a-f367-4a48-8aa8-e0bbe5b292a9-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ded4da01-b929-4279-a5f3-1bf6f1ab5d0c tempest-SnapshotMetadataTestJSON-1867735817 None] Created volume successfully. Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Lock "cinder-1936715a-f367-4a48-8aa8-e0bbe5b292a9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Acquiring lock "cinder-quobyte-1936715a-f367-4a48-8aa8-e0bbe5b292a9" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Lock "cinder-quobyte-1936715a-f367-4a48-8aa8-e0bbe5b292a9" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9001906-0280-4608-95dd-595e20bb002f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:46 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 Sep 15 18:57:46 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:47 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9" returned: 0 in 0.484s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:47 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9 Sep 15 18:57:47 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:47 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1936715a-f367-4a48-8aa8-e0bbe5b292a9" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Lock "cinder-quobyte-1936715a-f367-4a48-8aa8-e0bbe5b292a9" released by "delete_volume" :: held 0.863s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Creating offline snapshot eb39a7a6-38bc-42f9-a31c-c094b749cdfc of volume 25cb8e7a-5daa-4118-8db0-049fb7a520b6 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fb6d6e-66b6-40a2-aceb-b93dd2e57920]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:47 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Created reservations ['201c2f7e-a0e0-4d11-ac67-16dd5e0bfb88', '473a2061-a0f9-4bd0-be57-69b9921f24bc', '05b78c3b-952e-46a7-8bf0-de47d0c7a8ce', '44259d8d-a069-4603-842e-261c1d238f84'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:47 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 Sep 15 18:57:47 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:48 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:48 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:48 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6" returned: 0 in 0.449s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:48 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc 1G Sep 15 18:57:48 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:48 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.325s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:48 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Deleted volume successfully. Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bb294d39-7743-41bc-8bae-965301adfae0 tempest-VolumeImageDependencyTests-539263011 None] Lock "cinder-1936715a-f367-4a48-8aa8-e0bbe5b292a9-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Flow 'volume_create_manager' (18e962de-bc08-41e7-8a1b-d60b365e3887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da403f1-d296-4d48-bdfb-817de14661c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da403f1-d296-4d48-bdfb-817de14661c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-130227714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da5dd6ea379a44f2a5a58f5d4a0a6de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:48Z,use_quota=True,user_id='f79ad99a71e942e3a473a00c740e9b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0747fe52-012f-4400-9859-62ee01cd2d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0747fe52-012f-4400-9859-62ee01cd2d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0914e5d7-6805-465a-9084-7f6277ec4402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0914e5d7-6805-465a-9084-7f6277ec4402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb', 'volume_name': 'volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ee4d40-542b-4f3b-ac9b-b9bc891e4483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ee4d40-542b-4f3b-ac9b-b9bc891e4483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955ade05-2f01-435a-b9db-8101ef716c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:48 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Volume ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb', 'volume_size': 1} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:48 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc 1G" returned: 0 in 0.552s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:48 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc Sep 15 18:57:48 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:49 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc" returned: 0 in 0.346s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:49 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc is being set with open permissions: ugo+rw Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:49 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc Sep 15 18:57:49 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:49 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:49 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.info Sep 15 18:57:49 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:49 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.info" returned: 0 in 0.303s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:49 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.info is being set with open permissions: ugo+rw Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:49 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.info Sep 15 18:57:49 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Flow 'volume_create_manager' (3c56f82a-76cd-43bf-9e79-7fada7dc8635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee768d78-84be-49df-9994-d8dd37a231c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee768d78-84be-49df-9994-d8dd37a231c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808989803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5c73d2-9a47-483b-adb9-cd01e95538d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd400c553494c3c9efc777c1cc96ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:50Z,use_quota=True,user_id='3845ffb580704ce3b5db56cd8b0e3254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:49 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf2802f-6282-4590-872f-4fb3e2645180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf2802f-6282-4590-872f-4fb3e2645180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a92d27-82ca-44f3-89a3-bad7af38e1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a92d27-82ca-44f3-89a3-bad7af38e1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5c73d2-9a47-483b-adb9-cd01e95538d5', 'volume_name': 'volume-af5c73d2-9a47-483b-adb9-cd01e95538d5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:49 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c42601-1966-4aaf-909e-2a1ce67fdf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c42601-1966-4aaf-909e-2a1ce67fdf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec91c97-9956-4e93-ac81-9c5ea9fcb16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:50 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Volume af5c73d2-9a47-483b-adb9-cd01e95538d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5c73d2-9a47-483b-adb9-cd01e95538d5', 'volume_size': 1} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.info" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-130227714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da5dd6ea379a44f2a5a58f5d4a0a6de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:48Z,use_quota=True,user_id='f79ad99a71e942e3a473a00c740e9b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Creating volume ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:50 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:50 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb 1073741824 Sep 15 18:57:50 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d5e9b066-2081-4c2a-b06b-2dcc0d98a07a tempest-SnapshotMetadataTestJSON-1867735817 None] Create snapshot completed successfully Sep 15 18:57:50 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb 1073741824" returned: 0 in 0.525s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:50 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb Sep 15 18:57:50 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:50 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" returned: 0 in 0.283s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.909s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-808989803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5c73d2-9a47-483b-adb9-cd01e95538d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd400c553494c3c9efc777c1cc96ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:50Z,use_quota=True,user_id='3845ffb580704ce3b5db56cd8b0e3254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Creating volume af5c73d2-9a47-483b-adb9-cd01e95538d5 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:50 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955ade05-2f01-435a-b9db-8101ef716c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:50 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 1073741824 Sep 15 18:57:50 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ac63bb-2660-40dc-9c47-8c27d2434d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:50 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Volume volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb (ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb): created successfully Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ac63bb-2660-40dc-9c47-8c27d2434d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Flow 'volume_create_manager' (18e962de-bc08-41e7-8a1b-d60b365e3887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-05483f1e-23a2-4503-86bf-df09234d3bc1 tempest-SnapshotDependencyTests-1171667839 None] Created volume successfully. Sep 15 18:57:51 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 1073741824" returned: 0 in 0.492s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:51 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 Sep 15 18:57:51 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:51 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5" returned: 0 in 0.261s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec91c97-9956-4e93-ac81-9c5ea9fcb16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5c73d2-9a47-483b-adb9-cd01e95538d5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2111a651-b292-4c83-9d74-f4bca7391dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Acquiring lock "cinder-eb39a7a6-38bc-42f9-a31c-c094b749cdfc-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Volume volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 (af5c73d2-9a47-483b-adb9-cd01e95538d5): created successfully Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2111a651-b292-4c83-9d74-f4bca7391dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Flow 'volume_create_manager' (3c56f82a-76cd-43bf-9e79-7fada7dc8635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-eb39a7a6-38bc-42f9-a31c-c094b749cdfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Acquiring lock "cinder-quobyte-25cb8e7a-5daa-4118-8db0-049fb7a520b6" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4ac109ea-514b-462b-8231-578719f00a64 tempest-ProjectReaderTests-1786420615 None] Created volume successfully. Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-quobyte-25cb8e7a-5daa-4118-8db0-049fb7a520b6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Acquiring lock "cinder-quobyte-eb39a7a6-38bc-42f9-a31c-c094b749cdfc" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-quobyte-eb39a7a6-38bc-42f9-a31c-c094b749cdfc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Deleting offline snapshot eb39a7a6-38bc-42f9-a31c-c094b749cdfc of volume 25cb8e7a-5daa-4118-8db0-049fb7a520b6 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] snapshot_file for this snap is: volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[96580b5a-d5c5-4efc-9a78-141972b13b12]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Creating offline snapshot 49612af5-1a84-4150-beed-49f07cbeebc7 of volume ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eb9674-d187-40c6-82de-2a06f9dbefee]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:52 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc Sep 15 18:57:52 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:52 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb Sep 15 18:57:52 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "cinder-af5c73d2-9a47-483b-adb9-cd01e95538d5-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-af5c73d2-9a47-483b-adb9-cd01e95538d5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "cinder-quobyte-af5c73d2-9a47-483b-adb9-cd01e95538d5" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-quobyte-af5c73d2-9a47-483b-adb9-cd01e95538d5" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd09ae3d-f3d3-403a-b611-e59d1936e859]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:52 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc" returned: 0 in 0.422s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e8431e-1c06-40e3-8447-768f22cdc978]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:52 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" returned: 0 in 0.413s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:52 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 1G Sep 15 18:57:52 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:52 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 Sep 15 18:57:52 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:52 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 Sep 15 18:57:52 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:52 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5" returned: 0 in 0.385s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:52 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5 Sep 15 18:57:52 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:52 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6" returned: 0 in 0.415s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:52 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc Sep 15 18:57:52 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:52 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 1G" returned: 0 in 0.455s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:52 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 Sep 15 18:57:52 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:52 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af5c73d2-9a47-483b-adb9-cd01e95538d5" returned: 0 in 0.297s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-quobyte-af5c73d2-9a47-483b-adb9-cd01e95538d5" released by "delete_volume" :: held 0.729s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Created reservations ['910692b8-a053-4529-9244-d873ae7a427f', '1dfc742f-85bb-4566-9c10-41ac9ac4ad6d', 'cd5a53e5-b8d9-4adf-98d7-44b9e0d0a0ea', 'd495e615-d210-47df-8e09-20615031939c'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:53 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7" returned: 0 in 0.323s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:53 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 is being set with open permissions: ugo+rw Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:53 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:53 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:53 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc" returned: 0 in 0.401s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:53 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 Sep 15 18:57:53 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:53 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc Sep 15 18:57:53 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:53 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.264s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:53 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:53 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Deleted volume successfully. Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7" returned: 0 in 0.271s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7ea62bba-0aef-404b-bd6f-d334684f9404 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-af5c73d2-9a47-483b-adb9-cd01e95538d5-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:53 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6.eb39a7a6-38bc-42f9-a31c-c094b749cdfc" returned: 0 in 0.287s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-quobyte-eb39a7a6-38bc-42f9-a31c-c094b749cdfc" released by "_delete_snapshot" :: held 1.689s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-quobyte-25cb8e7a-5daa-4118-8db0-049fb7a520b6" released by "delete_snapshot" :: held 1.718s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:53 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.info Sep 15 18:57:53 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Created reservations ['08c4f7d0-d727-4f1e-a6a4-fb000b341f75', '7237f84e-f9b2-415c-932e-4a881fa9ccaf', '611cc396-90f1-4060-940c-510f16dd58c9', '4bc03651-26b1-4f94-8f1c-75f355fd771a'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:53 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Delete snapshot completed successfully. Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f6794a20-fec9-4ecb-ace5-c83c4535b624 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-eb39a7a6-38bc-42f9-a31c-c094b749cdfc-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:53 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.info" returned: 0 in 0.285s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:53 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.info is being set with open permissions: ugo+rw Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:53 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.info Sep 15 18:57:53 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Flow 'volume_create_manager' (f822a741-0901-453e-87ed-0b5feaa15d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7f9816-65d8-4de9-b574-a0e64cba2767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c7f9816-65d8-4de9-b574-a0e64cba2767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4561174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949573c4-d1fd-421c-a721-b4829b6c7633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd400c553494c3c9efc777c1cc96ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:54Z,use_quota=True,user_id='3845ffb580704ce3b5db56cd8b0e3254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c814b715-8653-4466-92c0-2e4f5f68b91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c814b715-8653-4466-92c0-2e4f5f68b91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e862e5c0-0be1-4b10-aa65-294bb0c5945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e862e5c0-0be1-4b10-aa65-294bb0c5945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949573c4-d1fd-421c-a721-b4829b6c7633', 'volume_name': 'volume-949573c4-d1fd-421c-a721-b4829b6c7633', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c74a4d1-afb6-41f7-b321-e250416a8a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c74a4d1-afb6-41f7-b321-e250416a8a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8132557c-2298-4c31-8fdd-3b73db81266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:53 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Volume 949573c4-d1fd-421c-a721-b4829b6c7633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949573c4-d1fd-421c-a721-b4829b6c7633', 'volume_size': 1} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Acquiring lock "cinder-25cb8e7a-5daa-4118-8db0-049fb7a520b6-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-25cb8e7a-5daa-4118-8db0-049fb7a520b6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Acquiring lock "cinder-quobyte-25cb8e7a-5daa-4118-8db0-049fb7a520b6" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:54 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.info" returned: 0 in 0.279s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-quobyte-25cb8e7a-5daa-4118-8db0-049fb7a520b6" acquired by "delete_volume" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.175s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-4561174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949573c4-d1fd-421c-a721-b4829b6c7633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd400c553494c3c9efc777c1cc96ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:54Z,use_quota=True,user_id='3845ffb580704ce3b5db56cd8b0e3254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Creating volume 949573c4-d1fd-421c-a721-b4829b6c7633 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:54 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1a7473-efbd-43ae-8a8b-414547c9daa7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:54 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633 1073741824 Sep 15 18:57:54 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3cad6728-792c-46a2-b74c-b314b2d56f8d tempest-SnapshotDependencyTests-1171667839 None] Create snapshot completed successfully Sep 15 18:57:54 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 Sep 15 18:57:54 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:54 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6" returned: 0 in 0.379s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:54 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6 Sep 15 18:57:54 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:54 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633 1073741824" returned: 0 in 0.443s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:54 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633 Sep 15 18:57:54 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:54 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-25cb8e7a-5daa-4118-8db0-049fb7a520b6" returned: 0 in 0.252s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-quobyte-25cb8e7a-5daa-4118-8db0-049fb7a520b6" released by "delete_volume" :: held 0.702s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Created reservations ['576a5ef2-1a39-496a-977c-817811084f43', 'a5d1f27c-087f-4c0e-8c3e-45d5ac4cca02', 'e268103a-579f-4adf-aced-827b4e4fbd47', '79a924cd-cd87-4de6-81dc-be16ac1e58a5'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:54 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633" returned: 0 in 0.263s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8132557c-2298-4c31-8fdd-3b73db81266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949573c4-d1fd-421c-a721-b4829b6c7633', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e3bcd2-cec1-451c-a017-1c37bd76c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:54 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Volume volume-949573c4-d1fd-421c-a721-b4829b6c7633 (949573c4-d1fd-421c-a721-b4829b6c7633): created successfully Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e3bcd2-cec1-451c-a017-1c37bd76c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Flow 'volume_create_manager' (f822a741-0901-453e-87ed-0b5feaa15d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f052c067-fabf-4fcb-b188-18208e4519e6 tempest-ProjectReaderTests-1786420615 None] Created volume successfully. Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:54 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:54 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:55 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Deleted volume successfully. Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f15dbfc3-3ae6-4eca-961a-0a7fa17c4926 tempest-SnapshotMetadataTestJSON-1867735817 None] Lock "cinder-25cb8e7a-5daa-4118-8db0-049fb7a520b6-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Flow 'volume_create_manager' (f53ebaa4-4bdf-4081-87bb-7d8585cb1a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f7d0fa-a392-4010-a99d-da8d53919c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f7d0fa-a392-4010-a99d-da8d53919c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4034c5-8958-4cdb-afeb-d617c1665de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da5dd6ea379a44f2a5a58f5d4a0a6de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=49612af5-1a84-4150-beed-49f07cbeebc7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:56Z,use_quota=True,user_id='f79ad99a71e942e3a473a00c740e9b42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92436f13-3a95-4254-96c9-4a2066f90cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92436f13-3a95-4254-96c9-4a2066f90cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907389d0-4fc7-4816-a0b4-dbc00e5d0ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907389d0-4fc7-4816-a0b4-dbc00e5d0ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d4034c5-8958-4cdb-afeb-d617c1665de1', 'volume_name': 'volume-7d4034c5-8958-4cdb-afeb-d617c1665de1', 'volume_size': 1, 'snapshot_id': '49612af5-1a84-4150-beed-49f07cbeebc7'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72f7e43-96a6-4a01-bc43-a9b9d08f6889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d72f7e43-96a6-4a01-bc43-a9b9d08f6889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7968c67-c23a-43c1-9d72-a33062651750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:55 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Volume 7d4034c5-8958-4cdb-afeb-d617c1665de1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d4034c5-8958-4cdb-afeb-d617c1665de1', 'volume_size': 1, 'snapshot_id': '49612af5-1a84-4150-beed-49f07cbeebc7'} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "cinder-quobyte-49612af5-1a84-4150-beed-49f07cbeebc7-7d4034c5-8958-4cdb-afeb-d617c1665de1" by "_create_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-49612af5-1a84-4150-beed-49f07cbeebc7-7d4034c5-8958-4cdb-afeb-d617c1665de1" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Creating volume 7d4034c5-8958-4cdb-afeb-d617c1665de1 from snapshot 49612af5-1a84-4150-beed-49f07cbeebc7 {{(pid=86137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "cinder-quobyte-7d4034c5-8958-4cdb-afeb-d617c1665de1" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-7d4034c5-8958-4cdb-afeb-d617c1665de1" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] snapshot: 49612af5-1a84-4150-beed-49f07cbeebc7, volume: 7d4034c5-8958-4cdb-afeb-d617c1665de1, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec470bb-f4d2-44d3-914a-5642748d2249]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Acquiring lock "cinder-949573c4-d1fd-421c-a721-b4829b6c7633-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Lock "cinder-949573c4-d1fd-421c-a721-b4829b6c7633-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Acquiring lock "cinder-quobyte-949573c4-d1fd-421c-a721-b4829b6c7633" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Lock "cinder-quobyte-949573c4-d1fd-421c-a721-b4829b6c7633" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:57:56 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 Sep 15 18:57:56 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[815b5059-e0fb-4fc8-93f5-fa2fc3d5c290]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:56 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633 Sep 15 18:57:56 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:56 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7" returned: 0 in 0.431s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b4f931-9e0e-4d31-b58f-f34d9d3287da]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:56 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb Sep 15 18:57:56 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:56 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633" returned: 0 in 0.444s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:56 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633 Sep 15 18:57:56 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:56 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" returned: 0 in 0.415s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:56 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-949573c4-d1fd-421c-a721-b4829b6c7633" returned: 0 in 0.298s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:56 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 Sep 15 18:57:56 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Lock "cinder-quobyte-949573c4-d1fd-421c-a721-b4829b6c7633" released by "delete_volume" :: held 0.802s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Created reservations ['fd9dbf8f-e98d-4929-8e41-7a3eb05b08cf', 'ac99c619-a33b-44d3-b6da-20b3df274e12', '746a0325-2fbf-418a-a877-df5606f3f549', '683a66f1-4521-4465-bb88-a3ca5a6060f6'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:57:57 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:57:57 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:57:57 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.331s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:57:57 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Deleted volume successfully. Sep 15 18:57:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-611f00e6-a3c5-4279-b2b8-a15584dd2efe tempest-ProjectReaderTests-1786420615 None] Lock "cinder-949573c4-d1fd-421c-a721-b4829b6c7633-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Flow 'volume_create_manager' (55694f6c-7005-4449-bbc7-759ba16bc6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52839826-6ae2-4c95-8307-ac60b85dae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52839826-6ae2-4c95-8307-ac60b85dae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195727205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b12d13a-90ac-4379-b5ef-845f4593bfe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd400c553494c3c9efc777c1cc96ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:58Z,use_quota=True,user_id='3845ffb580704ce3b5db56cd8b0e3254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea1a607-9c74-4dea-ab54-176e0aad1ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea1a607-9c74-4dea-ab54-176e0aad1ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d75a63-a60e-4407-aecd-1d58b5a37e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d75a63-a60e-4407-aecd-1d58b5a37e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b12d13a-90ac-4379-b5ef-845f4593bfe5', 'volume_name': 'volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23356e90-5da1-4636-bac4-7559aa0e8646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23356e90-5da1-4636-bac4-7559aa0e8646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47896c7-b6b0-4482-98ed-7dc208f5d987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:57:58 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Volume 4b12d13a-90ac-4379-b5ef-845f4593bfe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5', 'volume_size': 1} Sep 15 18:57:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:03 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1" returned: 0 in 7.045s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:03 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:58:03 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Converted 1024.00 MB image at 145.33 MB/s Sep 15 18:58:03 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 is being set with open permissions: ugo+rw Sep 15 18:58:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:03 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 Sep 15 18:58:03 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:04 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1" returned: 0 in 0.264s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-7d4034c5-8958-4cdb-afeb-d617c1665de1" released by "_copy_volume_from_snapshot" :: held 8.265s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-49612af5-1a84-4150-beed-49f07cbeebc7-7d4034c5-8958-4cdb-afeb-d617c1665de1" released by "_create_volume_from_snapshot" :: held 8.341s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.366s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.903s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1195727205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b12d13a-90ac-4379-b5ef-845f4593bfe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd400c553494c3c9efc777c1cc96ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:57:58Z,use_quota=True,user_id='3845ffb580704ce3b5db56cd8b0e3254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Creating volume 4b12d13a-90ac-4379-b5ef-845f4593bfe5 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:58:04 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:04 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 1073741824 Sep 15 18:58:04 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7968c67-c23a-43c1-9d72-a33062651750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4034c5-8958-4cdb-afeb-d617c1665de1', 'volume_size': 1, 'snapshot_id': '49612af5-1a84-4150-beed-49f07cbeebc7'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe142b98-3808-4c4b-bbde-eb0e2e72a9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Volume volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 (7d4034c5-8958-4cdb-afeb-d617c1665de1): created successfully Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe142b98-3808-4c4b-bbde-eb0e2e72a9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Flow 'volume_create_manager' (f53ebaa4-4bdf-4081-87bb-7d8585cb1a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b3c8b756-c723-4f22-a40e-bb18b347fbd6 tempest-SnapshotDependencyTests-1171667839 None] Created volume successfully. Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "cinder-49612af5-1a84-4150-beed-49f07cbeebc7-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-49612af5-1a84-4150-beed-49f07cbeebc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "cinder-quobyte-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "cinder-quobyte-49612af5-1a84-4150-beed-49f07cbeebc7" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-49612af5-1a84-4150-beed-49f07cbeebc7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Deleting offline snapshot 49612af5-1a84-4150-beed-49f07cbeebc7 of volume ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] snapshot_file for this snap is: volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba1c365-e5af-46b4-a57b-bebbe8a18bed]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:04 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 Sep 15 18:58:04 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:04 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 1073741824" returned: 0 in 0.527s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:04 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 Sep 15 18:58:04 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:05 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7" returned: 0 in 0.407s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 18:58:05 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5" returned: 0 in 0.276s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8023e0b-3fa0-4ee3-9959-9be6dc1af69b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47896c7-b6b0-4482-98ed-7dc208f5d987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c83e26c-be73-4e0c-bf36-0b17a01a31bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:05 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Volume volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 (4b12d13a-90ac-4379-b5ef-845f4593bfe5): created successfully Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c83e26c-be73-4e0c-bf36-0b17a01a31bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Flow 'volume_create_manager' (55694f6c-7005-4449-bbc7-759ba16bc6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3709a391-8747-4563-b9fd-08c888b88eca tempest-ProjectReaderTests-1786420615 None] Created volume successfully. Sep 15 18:58:05 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb Sep 15 18:58:05 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "cinder-4b12d13a-90ac-4379-b5ef-845f4593bfe5-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-4b12d13a-90ac-4379-b5ef-845f4593bfe5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:05 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" returned: 0 in 0.598s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "cinder-quobyte-4b12d13a-90ac-4379-b5ef-845f4593bfe5" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-quobyte-4b12d13a-90ac-4379-b5ef-845f4593bfe5" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:05 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 Sep 15 18:58:05 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[629f4a11-9d0f-493c-b62f-7e1e5a3ea2a4]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:05 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 Sep 15 18:58:05 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:06 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7" returned: 0 in 0.412s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:06 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7 Sep 15 18:58:06 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:06 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5" returned: 0 in 0.407s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:06 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5 Sep 15 18:58:06 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:06 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb.49612af5-1a84-4150-beed-49f07cbeebc7" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-49612af5-1a84-4150-beed-49f07cbeebc7" released by "_delete_snapshot" :: held 1.836s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" released by "delete_snapshot" :: held 1.865s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:06 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4b12d13a-90ac-4379-b5ef-845f4593bfe5" returned: 0 in 0.269s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-quobyte-4b12d13a-90ac-4379-b5ef-845f4593bfe5" released by "delete_volume" :: held 0.732s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Created reservations ['bc178d1f-68ab-43eb-a14b-80b2ebba2341', '938b032f-c886-4982-98fc-0a0cf2a02f8a', 'c1a85dec-6e03-4e85-98a5-740090f46c00', 'c8bc3b7e-7e2a-4156-961e-9ed5876891ec'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Created reservations ['d01b3f14-f276-4499-8401-5e1a27c2c6bf', 'cfd7b631-c316-4c77-88d9-9848eeee7e4b', '8944c7a3-86b0-480e-8425-07ad81b1d797', '1b0ec42f-acde-4232-aa27-cca2c1e8f1a5'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:06 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:58:06 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Delete snapshot completed successfully. Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-f0e3d66c-fd91-4234-b3c9-05aa9f1e45a3 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-49612af5-1a84-4150-beed-49f07cbeebc7-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "cinder-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "cinder-quobyte-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" acquired by "delete_volume" :: waited 0.039s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:06 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.332s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f9e653-9550-423a-827e-72eaf1896967]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Deleted volume successfully. Sep 15 18:58:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4b2e629-5f4e-4121-b556-4c0520077938 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-4b12d13a-90ac-4379-b5ef-845f4593bfe5-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:58:07 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb Sep 15 18:58:07 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Flow 'volume_create_manager' (68d54710-265f-4c50-ac11-aaad946a1400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b482d3-ff23-49d2-997b-15c26f970686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b482d3-ff23-49d2-997b-15c26f970686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1826288747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077a099c-1dfb-4904-973a-bc3c42583ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2673d47fa7ca45cf8606b2badd09883f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:58:07Z,use_quota=True,user_id='9ff3de3dbc0a4d55a8c1bcc086244125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18d8c5f-086d-401b-b7c5-3080cf4b7eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18d8c5f-086d-401b-b7c5-3080cf4b7eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79b92d2-8132-4cfd-b69f-eaf1e1a3f80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79b92d2-8132-4cfd-b69f-eaf1e1a3f80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '077a099c-1dfb-4904-973a-bc3c42583ec2', 'volume_name': 'volume-077a099c-1dfb-4904-973a-bc3c42583ec2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ef25b6-4dc8-40fc-8b6a-3fabbdd50455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0ef25b6-4dc8-40fc-8b6a-3fabbdd50455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0425e90-1cf4-4634-a099-487f98284560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Volume 077a099c-1dfb-4904-973a-bc3c42583ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-077a099c-1dfb-4904-973a-bc3c42583ec2', 'volume_size': 1} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1826288747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077a099c-1dfb-4904-973a-bc3c42583ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2673d47fa7ca45cf8606b2badd09883f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:58:07Z,use_quota=True,user_id='9ff3de3dbc0a4d55a8c1bcc086244125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Creating volume 077a099c-1dfb-4904-973a-bc3c42583ec2 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:58:07 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:07 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2 1073741824 Sep 15 18:58:07 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:58:07 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Flow 'volume_create_manager' (127ca345-dda5-4503-887a-09ad6ca25ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bb05b3-bd79-43ce-9921-d0e1852ff0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" returned: 0 in 0.457s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:07 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4bb05b3-bd79-43ce-9921-d0e1852ff0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2080714968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3497631f-c77a-49eb-8aeb-230a453e23cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd400c553494c3c9efc777c1cc96ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:58:07Z,use_quota=True,user_id='3845ffb580704ce3b5db56cd8b0e3254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:07 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca50e72d-5d41-4fdc-b19e-2fbfe293a6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca50e72d-5d41-4fdc-b19e-2fbfe293a6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f20785a-1206-4db1-9e2f-5806d03a37c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f20785a-1206-4db1-9e2f-5806d03a37c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3497631f-c77a-49eb-8aeb-230a453e23cc', 'volume_name': 'volume-3497631f-c77a-49eb-8aeb-230a453e23cc', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf77ab4-c683-4541-9ed2-292a32bbaac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf77ab4-c683-4541-9ed2-292a32bbaac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75a582c-2259-493a-8528-c50e92e94839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Volume 3497631f-c77a-49eb-8aeb-230a453e23cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3497631f-c77a-49eb-8aeb-230a453e23cc', 'volume_size': 1} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:07 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2 1073741824" returned: 0 in 0.452s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:07 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" returned: 0 in 0.277s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:07 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2 Sep 15 18:58:07 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb" released by "delete_volume" :: held 0.822s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Created reservations ['460122b1-f78a-47d0-b4ef-65822ea8dbb5', '615a21cd-fed5-4896-8f8d-1eddfdd6ff9f', '0f387b34-cdf0-4536-97d4-02c133bfa2ba', '47ffd9b1-e1fe-4436-94f3-3d7a1a2c624c'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:07 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:58:07 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:07 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2" returned: 0 in 0.278s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2080714968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3497631f-c77a-49eb-8aeb-230a453e23cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd400c553494c3c9efc777c1cc96ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:58:07Z,use_quota=True,user_id='3845ffb580704ce3b5db56cd8b0e3254',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Creating volume 3497631f-c77a-49eb-8aeb-230a453e23cc {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:58:07 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:07 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=234,cinder:DELETE=13,cinder:SELECT=182,cinder:INSERT=64 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "cinder-7d4034c5-8958-4cdb-afeb-d617c1665de1-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:08 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc 1073741824 Sep 15 18:58:08 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0425e90-1cf4-4634-a099-487f98284560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077a099c-1dfb-4904-973a-bc3c42583ec2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50700540-aa76-4bcc-b6f0-d7f3ce5b58b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:INSERT=68,cinder:UPDATE=225,cinder:SELECT=162,cinder:DELETE=23 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-7d4034c5-8958-4cdb-afeb-d617c1665de1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:08 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Volume volume-077a099c-1dfb-4904-973a-bc3c42583ec2 (077a099c-1dfb-4904-973a-bc3c42583ec2): created successfully Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50700540-aa76-4bcc-b6f0-d7f3ce5b58b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Flow 'volume_create_manager' (68d54710-265f-4c50-ac11-aaad946a1400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b0c1fa66-c90b-4cb0-aca3-281955ecdb25 tempest-VolumesTransfersV355Test-1544163511 None] Created volume successfully. Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "cinder-quobyte-7d4034c5-8958-4cdb-afeb-d617c1665de1" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:08 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-7d4034c5-8958-4cdb-afeb-d617c1665de1" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.326s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:58:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Deleted volume successfully. Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6022c4b-73a0-45b1-9d23-446f1ed6e398]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-42d8a175-791d-46c9-8466-85dc86561f69 tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-ffe00c73-3014-44d2-ab9a-5d69d8d6a4bb-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:08 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 Sep 15 18:58:08 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:08 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc 1073741824" returned: 0 in 0.498s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:08 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc Sep 15 18:58:08 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:08 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1" returned: 0 in 0.405s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:08 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1 Sep 15 18:58:08 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:08 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc" returned: 0 in 0.250s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75a582c-2259-493a-8528-c50e92e94839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3497631f-c77a-49eb-8aeb-230a453e23cc', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbb211b-a82e-4d90-95cf-c9f282681c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:08 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Volume volume-3497631f-c77a-49eb-8aeb-230a453e23cc (3497631f-c77a-49eb-8aeb-230a453e23cc): created successfully Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffbb211b-a82e-4d90-95cf-c9f282681c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Flow 'volume_create_manager' (127ca345-dda5-4503-887a-09ad6ca25ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-736302d6-6376-4269-8ae5-266dc7869ac5 tempest-ProjectReaderTests-1786420615 None] Created volume successfully. Sep 15 18:58:08 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-7d4034c5-8958-4cdb-afeb-d617c1665de1" returned: 0 in 0.257s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-quobyte-7d4034c5-8958-4cdb-afeb-d617c1665de1" released by "delete_volume" :: held 0.714s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Created reservations ['ebd6f637-71b8-4989-be23-0cb4d39a44a9', 'c972e7e2-2c8e-4592-987a-5c0495d58213', '0de8abdc-924c-44da-bfa0-1866a37274b2', '8d8965c6-4566-4434-a455-5dfd4d9d8f82'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:08 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:58:08 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:09 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:09 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:58:09 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Deleted volume successfully. Sep 15 18:58:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-952b6218-0cb7-449d-ada1-37573e1437cd tempest-SnapshotDependencyTests-1171667839 None] Lock "cinder-7d4034c5-8958-4cdb-afeb-d617c1665de1-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "cinder-3497631f-c77a-49eb-8aeb-230a453e23cc-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-3497631f-c77a-49eb-8aeb-230a453e23cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "cinder-quobyte-3497631f-c77a-49eb-8aeb-230a453e23cc" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-quobyte-3497631f-c77a-49eb-8aeb-230a453e23cc" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:09 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9858ee5c-88a8-432a-89aa-7295dd12e82f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:09 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc Sep 15 18:58:09 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:09 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ba4e8341-1285-46bc-ba89-3dd87ca7010f tempest-VolumesTransfersV355Test-1003408159 None] Transfer volume completed successfully. Sep 15 18:58:10 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc" returned: 0 in 0.410s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:10 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc Sep 15 18:58:10 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:10 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3497631f-c77a-49eb-8aeb-230a453e23cc" returned: 0 in 0.306s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-quobyte-3497631f-c77a-49eb-8aeb-230a453e23cc" released by "delete_volume" :: held 0.768s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Created reservations ['335e879e-a17a-4d8d-b9a5-06efcbc08317', '4e0ea1c7-e85e-45c4-8fa3-61ef3574e3cd', 'f5f60393-0ca9-4191-a0ba-5479e3bb646e', 'a0ea879b-39d5-45cc-84fc-bc96bfe805ba'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:10 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:58:10 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Acquiring lock "cinder-077a099c-1dfb-4904-973a-bc3c42583ec2-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Lock "cinder-077a099c-1dfb-4904-973a-bc3c42583ec2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Acquiring lock "cinder-quobyte-077a099c-1dfb-4904-973a-bc3c42583ec2" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Lock "cinder-quobyte-077a099c-1dfb-4904-973a-bc3c42583ec2" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d452fb5-ffb8-419e-93b0-7d901ce05088]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:10 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2 Sep 15 18:58:10 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:10 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.361s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:58:10 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Deleted volume successfully. Sep 15 18:58:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-94d17a16-caa2-41d6-9909-95566a293b93 tempest-ProjectReaderTests-1786420615 None] Lock "cinder-3497631f-c77a-49eb-8aeb-230a453e23cc-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:11 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2" returned: 0 in 0.468s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:11 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2 Sep 15 18:58:11 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:11 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-077a099c-1dfb-4904-973a-bc3c42583ec2" returned: 0 in 0.282s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Lock "cinder-quobyte-077a099c-1dfb-4904-973a-bc3c42583ec2" released by "delete_volume" :: held 0.827s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Created reservations ['152779e0-7177-422b-98bb-b586c20206c0', '7001b1ce-448d-4679-815f-599d9063b933', '9a21294e-ba0a-46f4-ab89-c2707f241c3d', '244bdd8f-d202-45e3-a139-4a8880ffd5a9'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:11 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:58:11 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:11 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.324s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:58:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Deleted volume successfully. Sep 15 18:58:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-c83a92e8-d99d-451c-835c-740c58e42518 tempest-VolumesTransfersV355Test-1002449444 None] Lock "cinder-077a099c-1dfb-4904-973a-bc3c42583ec2-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Flow 'volume_create_manager' (cbf0dec4-5294-40eb-8e6b-7b6628bc08e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef27c5e-45f9-4ea1-819d-eab424a5e3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef27c5e-45f9-4ea1-819d-eab424a5e3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-407417758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2962e8-8fe7-4caa-a624-a901059cc070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2673d47fa7ca45cf8606b2badd09883f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:58:12Z,use_quota=True,user_id='9ff3de3dbc0a4d55a8c1bcc086244125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b103bff-cb8a-42f9-bc9e-41d714663742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b103bff-cb8a-42f9-bc9e-41d714663742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33daab5b-b205-44c9-8ae7-50a4e25ea39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33daab5b-b205-44c9-8ae7-50a4e25ea39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2962e8-8fe7-4caa-a624-a901059cc070', 'volume_name': 'volume-3d2962e8-8fe7-4caa-a624-a901059cc070', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61723c9-a73c-4167-954e-a148cd9ec061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c61723c9-a73c-4167-954e-a148cd9ec061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d69ece9-3132-4d5e-a134-f5eb60ad2291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:12 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Volume 3d2962e8-8fe7-4caa-a624-a901059cc070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2962e8-8fe7-4caa-a624-a901059cc070', 'volume_size': 1} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-407417758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2962e8-8fe7-4caa-a624-a901059cc070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2673d47fa7ca45cf8606b2badd09883f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:58:12Z,use_quota=True,user_id='9ff3de3dbc0a4d55a8c1bcc086244125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Creating volume 3d2962e8-8fe7-4caa-a624-a901059cc070 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:58:12 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:58:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:12 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070 1073741824 Sep 15 18:58:12 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:13 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070 1073741824" returned: 0 in 0.517s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:13 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070 Sep 15 18:58:13 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:13 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070" returned: 0 in 0.246s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:58:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d69ece9-3132-4d5e-a134-f5eb60ad2291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2962e8-8fe7-4caa-a624-a901059cc070', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d567e2-6714-4663-8090-36a1679a9f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:13 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Volume volume-3d2962e8-8fe7-4caa-a624-a901059cc070 (3d2962e8-8fe7-4caa-a624-a901059cc070): created successfully Sep 15 18:58:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d567e2-6714-4663-8090-36a1679a9f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Flow 'volume_create_manager' (cbf0dec4-5294-40eb-8e6b-7b6628bc08e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:13 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7d9259ec-994d-4078-a425-710d088a0962 tempest-VolumesTransfersV355Test-1544163511 None] Created volume successfully. Sep 15 18:58:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Acquiring lock "cinder-3d2962e8-8fe7-4caa-a624-a901059cc070-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Lock "cinder-3d2962e8-8fe7-4caa-a624-a901059cc070-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Acquiring lock "cinder-quobyte-3d2962e8-8fe7-4caa-a624-a901059cc070" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Lock "cinder-quobyte-3d2962e8-8fe7-4caa-a624-a901059cc070" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:14 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe68d69-0608-409c-85d9-5045355e64b3]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:15 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070 Sep 15 18:58:15 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:15 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070" returned: 0 in 0.393s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:15 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070 Sep 15 18:58:15 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:15 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3d2962e8-8fe7-4caa-a624-a901059cc070" returned: 0 in 0.285s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Lock "cinder-quobyte-3d2962e8-8fe7-4caa-a624-a901059cc070" released by "delete_volume" :: held 0.735s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Created reservations ['7116e370-2a9a-4e8d-9de2-fec7d9c04377', 'c7c37714-8212-4045-82e6-d749849e2a5e', 'b04fa6c9-70dc-47df-89eb-89b4e1d9851a', 'c8d53e1f-a38a-405b-b148-deebc6decc59'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:15 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:58:15 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:16 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:16 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:58:16 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Deleted volume successfully. Sep 15 18:58:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aeefad42-9915-4892-b748-20ed3942fdab tempest-VolumesTransfersV355Test-1002449444 None] Lock "cinder-3d2962e8-8fe7-4caa-a624-a901059cc070-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=24,cinder:UPDATE=36,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:58:26 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:DELETE=4,cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=40 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Flow 'volume_create_manager' (68f1ff78-b0bb-4020-869b-c74d8271b014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfffc9e-3b76-47e9-8cb5-647ae7fd7f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bfffc9e-3b76-47e9-8cb5-647ae7fd7f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-171779168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfed8ab-6e6b-4222-a453-7ce963c0e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cde23e25b2748199bda332fff730ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:58:32Z,use_quota=True,user_id='778ee784f8a24d889d6b930b51a26a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ea2cb7-23e3-4502-8319-669868930fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ea2cb7-23e3-4502-8319-669868930fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d831d7-cda6-47cc-aaa3-31abbe78c6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d831d7-cda6-47cc-aaa3-31abbe78c6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdfed8ab-6e6b-4222-a453-7ce963c0e2ea', 'volume_name': 'volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e07ee1-7e1c-4896-a22b-ba484263d777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e07ee1-7e1c-4896-a22b-ba484263d777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06860b4f-c266-4380-afa0-1809105cdcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:32 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Volume cdfed8ab-6e6b-4222-a453-7ce963c0e2ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea', 'volume_size': 1} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-171779168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdfed8ab-6e6b-4222-a453-7ce963c0e2ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cde23e25b2748199bda332fff730ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:58:32Z,use_quota=True,user_id='778ee784f8a24d889d6b930b51a26a2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Creating volume cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:58:32 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:32 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea 1073741824 Sep 15 18:58:32 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:32 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea 1073741824" returned: 0 in 0.409s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:32 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea Sep 15 18:58:32 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:32 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" returned: 0 in 0.245s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:58:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06860b4f-c266-4380-afa0-1809105cdcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629014df-2ca8-41e6-94a0-5d5f77ae3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:58:33 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Volume volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea (cdfed8ab-6e6b-4222-a453-7ce963c0e2ea): created successfully Sep 15 18:58:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629014df-2ca8-41e6-94a0-5d5f77ae3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:58:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Flow 'volume_create_manager' (68f1ff78-b0bb-4020-869b-c74d8271b014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:58:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7337983a-8181-4398-8c83-e6e0c6991b06 tempest-VolumesActionsTest-327391127 None] Created volume successfully. Sep 15 18:58:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-722b686a-d280-49f4-81cd-22ed7e329eb1 tempest-VolumesActionsTest-327391127 None] Acquiring lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" by "attach_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-722b686a-d280-49f4-81cd-22ed7e329eb1 tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" acquired by "attach_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-722b686a-d280-49f4-81cd-22ed7e329eb1 tempest-VolumesActionsTest-327391127 None] Attaching volume cdfed8ab-6e6b-4222-a453-7ce963c0e2ea to instance 981ba84a-5940-40a7-8f49-2b1132b242c6 at mountpoint /dev/vdb on host None. Sep 15 18:58:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-722b686a-d280-49f4-81cd-22ed7e329eb1 tempest-VolumesActionsTest-327391127 None] Attach volume completed successfully. Sep 15 18:58:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-722b686a-d280-49f4-81cd-22ed7e329eb1 tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" released by "attach_volume" :: held 0.094s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a36e0db-7382-44a7-835c-768e4152803f tempest-VolumesActionsTest-327391127 None] Acquiring lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea-detach_volume" by "detach_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a36e0db-7382-44a7-835c-768e4152803f tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0a36e0db-7382-44a7-835c-768e4152803f tempest-VolumesActionsTest-327391127 None] Detaching volume cdfed8ab-6e6b-4222-a453-7ce963c0e2ea from instance 981ba84a-5940-40a7-8f49-2b1132b242c6. Sep 15 18:58:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0a36e0db-7382-44a7-835c-768e4152803f tempest-VolumesActionsTest-327391127 None] Detach volume completed successfully. Sep 15 18:58:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a36e0db-7382-44a7-835c-768e4152803f tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:58:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:58:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:58:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:58:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:45 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:58:45 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:46 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.339s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:58:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:58:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:58:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:58:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3901ad62-e62d-411c-bf9b-014e9d5da390 tempest-VolumesActionsTest-327391127 None] Acquiring lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" by "attach_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3901ad62-e62d-411c-bf9b-014e9d5da390 tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" acquired by "attach_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3901ad62-e62d-411c-bf9b-014e9d5da390 tempest-VolumesActionsTest-327391127 None] Attaching volume cdfed8ab-6e6b-4222-a453-7ce963c0e2ea to instance 26988702-d301-456f-a5d8-da1a35c8f839 at mountpoint /dev/vdb on host None. Sep 15 18:58:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3901ad62-e62d-411c-bf9b-014e9d5da390 tempest-VolumesActionsTest-327391127 None] Attach volume completed successfully. Sep 15 18:58:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3901ad62-e62d-411c-bf9b-014e9d5da390 tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" released by "attach_volume" :: held 0.090s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d76b47c1-0672-4d5f-a92f-621f5eb6acc3 tempest-VolumesActionsTest-327391127 None] Acquiring lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea-detach_volume" by "detach_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:58:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d76b47c1-0672-4d5f-a92f-621f5eb6acc3 tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:58:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d76b47c1-0672-4d5f-a92f-621f5eb6acc3 tempest-VolumesActionsTest-327391127 None] Detaching volume cdfed8ab-6e6b-4222-a453-7ce963c0e2ea from instance 26988702-d301-456f-a5d8-da1a35c8f839. Sep 15 18:58:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d76b47c1-0672-4d5f-a92f-621f5eb6acc3 tempest-VolumesActionsTest-327391127 None] Detach volume completed successfully. Sep 15 18:58:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d76b47c1-0672-4d5f-a92f-621f5eb6acc3 tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea-detach_volume" released by "detach_volume" :: held 0.061s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:58:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:58:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:58:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[631fd6d0-2c5b-4140-be5e-0d34394b70aa]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:55 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea Sep 15 18:58:55 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:55 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" returned: 0 in 0.354s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2580d7-ca4b-4a1f-9cd5-76af39ea683d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:58:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:55 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea Sep 15 18:58:55 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:58:55 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Sep 15 18:58:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" returned: 0 in 0.354s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:58:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.72c636cc-7a1b-4c55-bc55-db89130d8907nmitnwai.img {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:58:56 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.72c636cc-7a1b-4c55-bc55-db89130d8907nmitnwai.img Sep 15 18:58:56 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:01 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=8,cinder:SELECT=15,cinder:INSERT=5 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:59:01 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.72c636cc-7a1b-4c55-bc55-db89130d8907nmitnwai.img" returned: 0 in 5.615s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:01 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce66ec0-5bf4-4a74-a35c-b176361d09cc]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:59:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:01 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea Sep 15 18:59:01 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:02 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" returned: 0 in 0.535s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:02 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.72c636cc-7a1b-4c55-bc55-db89130d8907nmitnwai.img {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:59:02 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Converted 1024.00 MB image at 182.33 MB/s Sep 15 18:59:02 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] 72c636cc-7a1b-4c55-bc55-db89130d8907 was raw, no need to convert to raw {{(pid=86137) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 15 18:59:12 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:59:12 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=17,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:59:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.848s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:59:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Uploaded volume to glance image-id: 72c636cc-7a1b-4c55-bc55-db89130d8907. {{(pid=86137) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 15 18:59:20 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-749d6a77-3160-4e10-bfa2-a2fe76be1da0 tempest-VolumesActionsTest-327391127 None] Copy volume to image completed successfully. Sep 15 18:59:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:59:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:59:20 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6817b2-e8dd-4a22-8621-744ad03b3bc3]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:59:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:21 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea Sep 15 18:59:21 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:21 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" returned: 0 in 0.355s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:21 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2354c55-0726-4122-9867-6e3425b71c97]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:59:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:21 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea Sep 15 18:59:21 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:21 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" returned: 0 in 0.346s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:21 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img Sep 15 18:59:21 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:27 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img" returned: 0 in 5.712s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a75ad9d-fc0e-4a28-9fa5-feeeed60a611]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:59:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:27 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea Sep 15 18:59:27 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:27 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" returned: 0 in 0.514s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:27 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:59:27 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Converted 1024.00 MB image at 179.24 MB/s Sep 15 18:59:27 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aa was raw, converting to qcow2 {{(pid=86137) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 15 18:59:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae48010b-dc2b-4a00-9280-7d39377a4dee]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:59:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:28 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img Sep 15 18:59:28 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:28 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img" returned: 0 in 0.342s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:28 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img Sep 15 18:59:28 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:28 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img" returned: 1 in 0.322s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 18:59:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img /opt/stack/data/cinder/conversion/vol_upload_u8dfi5uy {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:28 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img /opt/stack/data/cinder/conversion/vol_upload_u8dfi5uy Sep 15 18:59:28 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:28 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img /opt/stack/data/cinder/conversion/vol_upload_u8dfi5uy" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:28 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Image conversion details: src /opt/stack/data/cinder/conversion/cdfed8ab-6e6b-4222-a453-7ce963c0e2ea.temp_image.fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aaw8kpjmv0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u8dfi5uy {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 18:59:28 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 15 18:59:28 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4733d2-df7a-4e69-8119-c0fec47c4976]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:59:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8dfi5uy {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:28 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8dfi5uy Sep 15 18:59:28 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:29 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8dfi5uy" returned: 0 in 0.317s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.507s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:59:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Uploaded volume to glance image-id: fd5c1fd2-bdc3-4e13-9ac1-4ab52dc254aa. {{(pid=86137) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 15 18:59:30 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9ac2be81-8366-4432-85db-1d478e9b6a04 tempest-VolumesActionsTest-327391127 None] Copy volume to image completed successfully. Sep 15 18:59:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Acquiring lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:59:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Acquiring lock "cinder-quobyte-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Lock "cinder-quobyte-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[88315142-2315-4799-8fed-0a3425f57fc0]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:32 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea Sep 15 18:59:32 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:32 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" returned: 0 in 0.366s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:32 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea Sep 15 18:59:32 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:32 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" returned: 0 in 0.243s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Lock "cinder-quobyte-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea" released by "delete_volume" :: held 0.649s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Created reservations ['d403d708-4525-4d34-a627-d819afcdef81', '921bbf40-bf5a-4e5b-9ec6-06e0871a0d97', 'f34d6804-0969-41d3-b932-e47338dd6992', '5d7b02b5-dbea-4d76-8c59-121561ffd5f6'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:59:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:32 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:59:32 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:33 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.244s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:33 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:59:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Deleted volume successfully. Sep 15 18:59:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-86d860fe-2078-4906-a60c-5637162824ad tempest-VolumesActionsTest-327391127 None] Lock "cinder-cdfed8ab-6e6b-4222-a453-7ce963c0e2ea-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 18:59:42 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=8,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:59:43 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 18:59:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:59:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:59:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:59:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:59:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:59:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:59:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:45 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 18:59:45 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:46 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.282s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 18:59:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 18:59:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 18:59:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Flow 'volume_create_manager' (7522c1a2-7fa7-4f34-bc67-b5fbc025a910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d9f230-443d-4c3d-bb35-fc1be2cd209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d9f230-443d-4c3d-bb35-fc1be2cd209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1244818960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5288b7c1-f135-4d70-bc8e-9b4912548b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7964226efb34bfba7b9d2767cd3459b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:59:58Z,use_quota=True,user_id='c06394a04bd4461ea5b54daf60e42409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0de1f98-e24f-4993-975d-f2565fab49c2),volume_type_id=b0de1f98-e24f-4993-975d-f2565fab49c2)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327354ba-8ad8-4f13-88d8-23b4d392719e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327354ba-8ad8-4f13-88d8-23b4d392719e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca347be-c9ff-4709-a7e3-22c2492738ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca347be-c9ff-4709-a7e3-22c2492738ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5288b7c1-f135-4d70-bc8e-9b4912548b43', 'volume_name': 'volume-5288b7c1-f135-4d70-bc8e-9b4912548b43', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71a3f66-e979-4324-a5ca-bcbbf9562a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71a3f66-e979-4324-a5ca-bcbbf9562a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7705144a-aa16-4b89-94f6-b813b570429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Volume 5288b7c1-f135-4d70-bc8e-9b4912548b43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5288b7c1-f135-4d70-bc8e-9b4912548b43', 'volume_size': 1} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1244818960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5288b7c1-f135-4d70-bc8e-9b4912548b43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7964226efb34bfba7b9d2767cd3459b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:59:58Z,use_quota=True,user_id='c06394a04bd4461ea5b54daf60e42409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0de1f98-e24f-4993-975d-f2565fab49c2),volume_type_id=b0de1f98-e24f-4993-975d-f2565fab49c2)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Creating volume 5288b7c1-f135-4d70-bc8e-9b4912548b43 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:59:58 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:58 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 1073741824 Sep 15 18:59:58 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Flow 'volume_create_manager' (ec7bba76-f797-4418-a88d-718afe5e7a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188fcf81-94de-42f3-af7f-9b1a4adbe61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (188fcf81-94de-42f3-af7f-9b1a4adbe61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1471750622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db030b6c-9366-4714-98ac-1779238a51e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7964226efb34bfba7b9d2767cd3459b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:59:59Z,use_quota=True,user_id='c06394a04bd4461ea5b54daf60e42409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d29a4ea-8035-4800-99d1-e513b088f9f5),volume_type_id=2d29a4ea-8035-4800-99d1-e513b088f9f5)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa9243f-1076-4c23-a5c3-b7d66aa873db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa9243f-1076-4c23-a5c3-b7d66aa873db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db26f29-e84f-4e63-9c71-b1782430080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db26f29-e84f-4e63-9c71-b1782430080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db030b6c-9366-4714-98ac-1779238a51e3', 'volume_name': 'volume-db030b6c-9366-4714-98ac-1779238a51e3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df1fc2c-724c-4af2-92ef-495d043e2735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df1fc2c-724c-4af2-92ef-495d043e2735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530d8287-2810-410d-9635-51592dec626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:58 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Volume db030b6c-9366-4714-98ac-1779238a51e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db030b6c-9366-4714-98ac-1779238a51e3', 'volume_size': 1} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:59:58 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 1073741824" returned: 0 in 0.505s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:58 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 Sep 15 18:59:58 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:59 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43" returned: 0 in 0.273s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1471750622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db030b6c-9366-4714-98ac-1779238a51e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7964226efb34bfba7b9d2767cd3459b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:59:59Z,use_quota=True,user_id='c06394a04bd4461ea5b54daf60e42409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d29a4ea-8035-4800-99d1-e513b088f9f5),volume_type_id=2d29a4ea-8035-4800-99d1-e513b088f9f5)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Creating volume db030b6c-9366-4714-98ac-1779238a51e3 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 18:59:59 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7705144a-aa16-4b89-94f6-b813b570429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5288b7c1-f135-4d70-bc8e-9b4912548b43', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:59 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3 1073741824 Sep 15 18:59:59 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72b81a0-11b0-480e-ab51-e445f62179d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Volume volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 (5288b7c1-f135-4d70-bc8e-9b4912548b43): created successfully Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72b81a0-11b0-480e-ab51-e445f62179d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Flow 'volume_create_manager' (7522c1a2-7fa7-4f34-bc67-b5fbc025a910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:59:59 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ddfba953-2d8b-4804-bad6-6e8f4c280bb1 tempest-TestInstancesWithCinderVolumes-946957955 None] Created volume successfully. Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Flow 'volume_create_manager' (d02c8e26-8e33-4efa-836f-1ebc45ae1988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c9f2c1-03c3-459b-bc22-ca9bc7ec22f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c9f2c1-03c3-459b-bc22-ca9bc7ec22f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1305010857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f208a108-f38a-458f-b037-a934c55d85cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7964226efb34bfba7b9d2767cd3459b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:59:59Z,use_quota=True,user_id='c06394a04bd4461ea5b54daf60e42409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4029acd-c50d-4dc5-b3a5-51e511ec72f2),volume_type_id=a4029acd-c50d-4dc5-b3a5-51e511ec72f2)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefb6fcd-ff64-413c-baf5-069c684dee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefb6fcd-ff64-413c-baf5-069c684dee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a20ec3e-b06a-42d6-9cdd-0f01d388fcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a20ec3e-b06a-42d6-9cdd-0f01d388fcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f208a108-f38a-458f-b037-a934c55d85cf', 'volume_name': 'volume-f208a108-f38a-458f-b037-a934c55d85cf', 'volume_size': 1, 'image_id': '26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--448540616', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7964226efb34bfba7b9d2767cd3459b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'created_at': datetime.datetime(2026, 9, 15, 16, 59, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 59, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26c2a28e-c891-4ebf-9356-d0322fdb3caf/file', 'properties': {}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7631d40b-f380-48ac-90cb-918a7a865a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7631d40b-f380-48ac-90cb-918a7a865a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80597e5-38b7-4139-a218-ba77f1c26cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 18:59:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Volume f208a108-f38a-458f-b037-a934c55d85cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f208a108-f38a-458f-b037-a934c55d85cf', 'volume_size': 1, 'image_id': '26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--448540616', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7964226efb34bfba7b9d2767cd3459b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'created_at': datetime.datetime(2026, 9, 15, 16, 59, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 59, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26c2a28e-c891-4ebf-9356-d0322fdb3caf/file', 'properties': {}}, 'image_service': } Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Trying to clone f208a108-f38a-458f-b037-a934c55d85cf from image 26c2a28e-c891-4ebf-9356-d0322fdb3caf at location (None, [{'url': 'file:///opt/stack/data/glance/images/26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 18:59:59 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3 1073741824" returned: 0 in 0.461s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 18:59:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 18:59:59 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3 Sep 15 18:59:59 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:00 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3" returned: 0 in 0.265s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:00 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:00:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530d8287-2810-410d-9635-51592dec626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db030b6c-9366-4714-98ac-1779238a51e3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:00:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acb665a-2763-4ad1-93b3-24e54e82c03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:00:00 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Volume volume-db030b6c-9366-4714-98ac-1779238a51e3 (db030b6c-9366-4714-98ac-1779238a51e3): created successfully Sep 15 19:00:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acb665a-2763-4ad1-93b3-24e54e82c03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:00:00 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Flow 'volume_create_manager' (ec7bba76-f797-4418-a88d-718afe5e7a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:00:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-277bc79a-6697-46ab-b01a-189c92877ff5 tempest-TestInstancesWithCinderVolumes-946957955 None] Created volume successfully. Sep 15 19:00:02 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD, size 20.69 MB, duration 2.73 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 19:00:02 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Image download 20.69 MB at 7.58 MB/s Sep 15 19:00:02 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d73441-452f-4106-b84c-20a7b4d63dee]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:00:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:02 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD Sep 15 19:00:02 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:02 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:02 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Temporary image 26c2a28e-c891-4ebf-9356-d0322fdb3caf is fetched for user c06394a04bd4461ea5b54daf60e42409. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 19:00:02 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf80aec4-1f64-4d8e-8501-7386a6ac7cc2]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:00:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:02 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD Sep 15 19:00:02 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:03 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T16:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1305010857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f208a108-f38a-458f-b037-a934c55d85cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7964226efb34bfba7b9d2767cd3459b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T16:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T16:59:59Z,use_quota=True,user_id='c06394a04bd4461ea5b54daf60e42409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4029acd-c50d-4dc5-b3a5-51e511ec72f2),volume_type_id=a4029acd-c50d-4dc5-b3a5-51e511ec72f2)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Creating volume f208a108-f38a-458f-b037-a934c55d85cf {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:00:03 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:03 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf 1073741824 Sep 15 19:00:03 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:03 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf 1073741824" returned: 0 in 0.410s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:03 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf Sep 15 19:00:03 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:03 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf" returned: 0 in 0.236s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Attempting download of 26c2a28e-c891-4ebf-9356-d0322fdb3caf ((None, [{'url': 'file:///opt/stack/data/glance/images/26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'metadata': {}}])) to volume f208a108-f38a-458f-b037-a934c55d85cf. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6c4b62-fe93-464a-833b-ebc96cee4ec8]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:00:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26c2a28e-c891-4ebf-9356-d0322fdb3caf_ixp9iwto {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:03 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26c2a28e-c891-4ebf-9356-d0322fdb3caf_ixp9iwto Sep 15 19:00:03 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:04 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26c2a28e-c891-4ebf-9356-d0322fdb3caf_ixp9iwto" returned: 0 in 0.315s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26c2a28e-c891-4ebf-9356-d0322fdb3caf_ixp9iwto {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:04 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26c2a28e-c891-4ebf-9356-d0322fdb3caf_ixp9iwto Sep 15 19:00:04 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:04 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26c2a28e-c891-4ebf-9356-d0322fdb3caf_ixp9iwto" returned: 1 in 0.313s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26c2a28e-c891-4ebf-9356-d0322fdb3caf_ixp9iwto' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 19:00:04 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[82884f73-53dd-47a8-83ef-d0696e960346]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:00:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:04 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD Sep 15 19:00:04 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:04 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:04 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] 26c2a28e-c891-4ebf-9356-d0322fdb3caf was qcow2, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 19:00:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:04 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf Sep 15 19:00:04 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:06 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf" returned: 0 in 1.647s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26c2a28e-c891-4ebf-9356-d0322fdb3caf_3a3gxwmkdevstack@QuobyteHD, size 112.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 19:00:06 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Converted 112.00 MB image at 67.94 MB/s Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:06 devstack sudo[102255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf 1G Sep 15 19:00:06 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:06 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf 1G" returned: 0 in 0.325s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Downloaded image 26c2a28e-c891-4ebf-9356-d0322fdb3caf ((None, [{'url': 'file:///opt/stack/data/glance/images/26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'metadata': {}}])) to volume f208a108-f38a-458f-b037-a934c55d85cf successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Temporary image 26c2a28e-c891-4ebf-9356-d0322fdb3caf for user c06394a04bd4461ea5b54daf60e42409 is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Marking volume f208a108-f38a-458f-b037-a934c55d85cf as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Copying metadata from image 26c2a28e-c891-4ebf-9356-d0322fdb3caf to f208a108-f38a-458f-b037-a934c55d85cf. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Creating volume glance metadata for volume f208a108-f38a-458f-b037-a934c55d85cf backed by image 26c2a28e-c891-4ebf-9356-d0322fdb3caf with: {'image_id': '26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'image_name': 'tempest-scenario-img--448540616', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f80597e5-38b7-4139-a218-ba77f1c26cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f208a108-f38a-458f-b037-a934c55d85cf', 'volume_size': 1, 'image_id': '26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--448540616', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c7964226efb34bfba7b9d2767cd3459b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '26c2a28e-c891-4ebf-9356-d0322fdb3caf', 'created_at': datetime.datetime(2026, 9, 15, 16, 59, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 16, 59, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26c2a28e-c891-4ebf-9356-d0322fdb3caf/file', 'properties': {}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca491007-bccf-4570-90c1-4d5ec92097c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:00:06 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Volume volume-f208a108-f38a-458f-b037-a934c55d85cf (f208a108-f38a-458f-b037-a934c55d85cf): created successfully Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca491007-bccf-4570-90c1-4d5ec92097c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:00:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Flow 'volume_create_manager' (d02c8e26-8e33-4efa-836f-1ebc45ae1988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:00:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-45cafec4-4ddf-4b45-90fa-260193de3147 tempest-TestInstancesWithCinderVolumes-946957955 None] Created volume successfully. Sep 15 19:00:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-32e17e22-3e11-4820-8343-15051813726b req-ed598f68-705e-46dc-9ed6-ae7f482a9bef tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:00:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-32e17e22-3e11-4820-8343-15051813726b req-ed598f68-705e-46dc-9ed6-ae7f482a9bef tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:00:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-32e17e22-3e11-4820-8343-15051813726b req-ed598f68-705e-46dc-9ed6-ae7f482a9bef tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-32e17e22-3e11-4820-8343-15051813726b req-ed598f68-705e-46dc-9ed6-ae7f482a9bef tempest-TestInstancesWithCinderVolumes-946957955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-f208a108-f38a-458f-b037-a934c55d85cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0c626f1-ff9c-4818-ae7b-f9b61ddf6dd8', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 19:00:10 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-32e17e22-3e11-4820-8343-15051813726b req-ed598f68-705e-46dc-9ed6-ae7f482a9bef tempest-TestInstancesWithCinderVolumes-946957955 None] attachment_update completed successfully. Sep 15 19:00:20 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=15,cinder:UPDATE=12,cinder:INSERT=9,cinder:DELETE=3 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:00:20 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=21,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:00:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-2c81804d-deb3-4914-8ecf-141858bcf5df req-4fe083c0-c19a-4275-9202-e7e97857e5b1 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:00:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-2c81804d-deb3-4914-8ecf-141858bcf5df req-4fe083c0-c19a-4275-9202-e7e97857e5b1 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:00:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-2c81804d-deb3-4914-8ecf-141858bcf5df req-4fe083c0-c19a-4275-9202-e7e97857e5b1 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-2c81804d-deb3-4914-8ecf-141858bcf5df req-4fe083c0-c19a-4275-9202-e7e97857e5b1 tempest-TestInstancesWithCinderVolumes-946957955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-5288b7c1-f135-4d70-bc8e-9b4912548b43', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f066139b-c5c4-4ab6-9264-9a6d41e8fb6b', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 19:00:41 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-2c81804d-deb3-4914-8ecf-141858bcf5df req-4fe083c0-c19a-4275-9202-e7e97857e5b1 tempest-TestInstancesWithCinderVolumes-946957955 None] attachment_update completed successfully. Sep 15 19:00:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-02a41929-ba94-4782-a364-ce1ce0c6f15a req-a62d59dd-03d1-494b-82d5-849139c1e84e tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:00:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-02a41929-ba94-4782-a364-ce1ce0c6f15a req-a62d59dd-03d1-494b-82d5-849139c1e84e tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:00:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-02a41929-ba94-4782-a364-ce1ce0c6f15a req-a62d59dd-03d1-494b-82d5-849139c1e84e tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-02a41929-ba94-4782-a364-ce1ce0c6f15a req-a62d59dd-03d1-494b-82d5-849139c1e84e tempest-TestInstancesWithCinderVolumes-946957955 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-db030b6c-9366-4714-98ac-1779238a51e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55e76bf7-7e55-445a-92b6-173baf6714e3', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 19:00:43 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-02a41929-ba94-4782-a364-ce1ce0c6f15a req-a62d59dd-03d1-494b-82d5-849139c1e84e tempest-TestInstancesWithCinderVolumes-946957955 None] attachment_update completed successfully. Sep 15 19:00:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:00:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:00:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:00:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:00:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:00:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:45 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:00:45 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:46 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:00:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:00:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 19:00:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 19:00:48 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-59898609-d422-4956-a10e-8c692305fde6 req-5d2dc9a8-92dd-4f9f-8b19-113d3f35b70c tempest-TestInstancesWithCinderVolumes-946957955 None] Terminate volume connection completed successfully. Sep 15 19:00:48 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-59898609-d422-4956-a10e-8c692305fde6 req-5d2dc9a8-92dd-4f9f-8b19-113d3f35b70c tempest-TestInstancesWithCinderVolumes-946957955 None] Deleting attachment f066139b-c5c4-4ab6-9264-9a6d41e8fb6b. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 19:00:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "cinder-5288b7c1-f135-4d70-bc8e-9b4912548b43-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:00:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-5288b7c1-f135-4d70-bc8e-9b4912548b43-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:00:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "cinder-quobyte-5288b7c1-f135-4d70-bc8e-9b4912548b43" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:00:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-quobyte-5288b7c1-f135-4d70-bc8e-9b4912548b43" acquired by "delete_volume" :: waited 0.014s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:00:48 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0e9ea8-8c1b-44c1-b0c2-881d17b5b48f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:00:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:49 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 Sep 15 19:00:49 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:49 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43" returned: 0 in 0.396s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:49 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43 Sep 15 19:00:49 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:49 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-5288b7c1-f135-4d70-bc8e-9b4912548b43" returned: 0 in 0.281s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-quobyte-5288b7c1-f135-4d70-bc8e-9b4912548b43" released by "delete_volume" :: held 0.722s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:00:49 devstack cinder-volume[86137]: WARNING cinder.quota [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-978507790-720916886 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-978507790-720916886, it is now deprecated. Please use the default quota class for default quota. Sep 15 19:00:49 devstack cinder-volume[86137]: WARNING cinder.quota [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-978507790-720916886 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-978507790-720916886, it is now deprecated. Please use the default quota class for default quota. Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Created reservations ['64782283-e72a-4c02-87bd-d93be35dc49e', '18baa21c-e7b7-49ac-a879-91318c32c6c6', '547316c5-7449-4983-9768-ceb739ad3fae', 'ec446ca1-a656-4a8c-9580-e9e5805029d4'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:49 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:00:49 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:50 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.286s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:50 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:00:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Deleted volume successfully. Sep 15 19:00:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-efe47f4a-4e5f-4ed8-9803-2e3b56f69465 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-5288b7c1-f135-4d70-bc8e-9b4912548b43-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:00:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-e423a1c8-9fb5-4501-b211-c343704ed166 req-fc32a7da-423d-40c3-9469-79dbfdce241b tempest-TestInstancesWithCinderVolumes-946957955 None] Terminate volume connection completed successfully. Sep 15 19:00:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-e423a1c8-9fb5-4501-b211-c343704ed166 req-fc32a7da-423d-40c3-9469-79dbfdce241b tempest-TestInstancesWithCinderVolumes-946957955 None] Deleting attachment 55e76bf7-7e55-445a-92b6-173baf6714e3. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 19:00:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "cinder-db030b6c-9366-4714-98ac-1779238a51e3-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-db030b6c-9366-4714-98ac-1779238a51e3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "cinder-quobyte-db030b6c-9366-4714-98ac-1779238a51e3" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-quobyte-db030b6c-9366-4714-98ac-1779238a51e3" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d091aef-a287-4a85-a3bd-89e61b909834]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:53 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3 Sep 15 19:00:53 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:53 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3" returned: 0 in 0.385s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:53 devstack sudo[102966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3 Sep 15 19:00:53 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:53 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-db030b6c-9366-4714-98ac-1779238a51e3" returned: 0 in 0.256s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-quobyte-db030b6c-9366-4714-98ac-1779238a51e3" released by "delete_volume" :: held 0.688s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:00:53 devstack cinder-volume[86137]: WARNING cinder.quota [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1865502978-1903793159 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1865502978-1903793159, it is now deprecated. Please use the default quota class for default quota. Sep 15 19:00:53 devstack cinder-volume[86137]: WARNING cinder.quota [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1865502978-1903793159 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1865502978-1903793159, it is now deprecated. Please use the default quota class for default quota. Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Created reservations ['dd825d28-44a2-48a6-8edb-57b58a744b4a', '4eed07e3-ae9a-481b-bef4-728dcb379c60', '8f0e5cab-25bb-4dd6-bbd9-ef1bcd6e2547', '8a498c33-06d9-4097-afeb-c8e46f7a1fc2'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:53 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:00:53 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:54 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.274s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:54 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:00:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Deleted volume successfully. Sep 15 19:00:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-def07fb0-563c-4c60-8ee2-9e1f05926bbe tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-db030b6c-9366-4714-98ac-1779238a51e3-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:00:56 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-b7ddaec9-fbb0-4af1-8873-7593b0a431ba req-aa90ba48-d77f-4bbd-99b8-a51ec3dc37c5 tempest-TestInstancesWithCinderVolumes-946957955 None] Terminate volume connection completed successfully. Sep 15 19:00:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-b7ddaec9-fbb0-4af1-8873-7593b0a431ba req-aa90ba48-d77f-4bbd-99b8-a51ec3dc37c5 tempest-TestInstancesWithCinderVolumes-946957955 None] Deleting attachment e0c626f1-ff9c-4818-ae7b-f9b61ddf6dd8. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 19:00:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "cinder-f208a108-f38a-458f-b037-a934c55d85cf-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:00:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-f208a108-f38a-458f-b037-a934c55d85cf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:00:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "cinder-quobyte-f208a108-f38a-458f-b037-a934c55d85cf" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:00:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-quobyte-f208a108-f38a-458f-b037-a934c55d85cf" acquired by "delete_volume" :: waited 0.013s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:00:57 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcf2a2c-e2af-450c-9b0c-7c1972dabe0b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:00:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:58 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf Sep 15 19:00:58 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:58 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf" returned: 0 in 0.347s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:58 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf Sep 15 19:00:58 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:58 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f208a108-f38a-458f-b037-a934c55d85cf" returned: 0 in 0.243s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-quobyte-f208a108-f38a-458f-b037-a934c55d85cf" released by "delete_volume" :: held 0.633s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:00:58 devstack cinder-volume[86137]: WARNING cinder.quota [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842825654-1100301283 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842825654-1100301283, it is now deprecated. Please use the default quota class for default quota. Sep 15 19:00:58 devstack cinder-volume[86137]: WARNING cinder.quota [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842825654-1100301283 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-842825654-1100301283, it is now deprecated. Please use the default quota class for default quota. Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Created reservations ['26629f33-916c-4d89-b093-eb1ad82a3b10', '06e42a99-b8cd-48ba-8a07-e62e50135996', '7515bafe-758a-48ce-ab50-41db9e20e460', '1e1f5bbc-d823-4c76-b47d-3749c58420db'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:00:58 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:00:58 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:00:58 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.240s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:00:58 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Deleted volume successfully. Sep 15 19:00:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-194115ee-fa96-4607-8448-fd268f52ac36 tempest-TestInstancesWithCinderVolumes-946957955 None] Lock "cinder-f208a108-f38a-458f-b037-a934c55d85cf-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:01:08 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=27,cinder:UPDATE=31,cinder:INSERT=6 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:01:08 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=35,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:01:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:01:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Flow 'volume_create_manager' (6527cb36-8d72-467c-9c7a-a76db1555d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6972041a-28df-4bbb-8a6c-93477f58fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6972041a-28df-4bbb-8a6c-93477f58fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2083288203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5a9b9b-21cd-4d76-9657-2b929217d5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3f6f1a174c41cc92b96ab18d3edba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:01:42Z,use_quota=True,user_id='c4f5c1be61e44de5bb84b0875044f263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739ab6ae-a05a-4ca8-aed1-0c28e74e6889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (739ab6ae-a05a-4ca8-aed1-0c28e74e6889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2413a339-ab42-4608-9295-41e0a838ef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2413a339-ab42-4608-9295-41e0a838ef72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5a9b9b-21cd-4d76-9657-2b929217d5ae', 'volume_name': 'volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd576ff-b3c0-40eb-86fd-e3b131e39bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd576ff-b3c0-40eb-86fd-e3b131e39bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0cbd40-30db-45b1-9567-bfb98be5a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:01:41 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Volume 0b5a9b9b-21cd-4d76-9657-2b929217d5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae', 'volume_size': 1} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2083288203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5a9b9b-21cd-4d76-9657-2b929217d5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b3f6f1a174c41cc92b96ab18d3edba7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:01:42Z,use_quota=True,user_id='c4f5c1be61e44de5bb84b0875044f263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Creating volume 0b5a9b9b-21cd-4d76-9657-2b929217d5ae {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:01:41 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:01:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:01:41 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae 1073741824 Sep 15 19:01:41 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:01:42 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 15 19:01:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae 1073741824" returned: 0 in 0.443s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:01:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:01:42 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae Sep 15 19:01:42 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:01:42 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Sep 15 19:01:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae" returned: 0 in 0.258s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:01:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:01:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:01:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0cbd40-30db-45b1-9567-bfb98be5a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:01:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cf19ce-a364-4b19-beaa-304a7cae4dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:01:42 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Volume volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae (0b5a9b9b-21cd-4d76-9657-2b929217d5ae): created successfully Sep 15 19:01:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cf19ce-a364-4b19-beaa-304a7cae4dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:01:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Flow 'volume_create_manager' (6527cb36-8d72-467c-9c7a-a76db1555d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:01:42 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b306c5d9-84d5-4bd2-a7cc-0c4377efb8a5 tempest-TestMinimumBasicScenario-1068285597 None] Created volume successfully. Sep 15 19:01:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-a68b043e-8c99-4fb3-8ce5-b1801e6c9d1a req-6c815901-fd9e-4769-b428-721ac5f356c4 tempest-TestMinimumBasicScenario-1068285597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:01:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-a68b043e-8c99-4fb3-8ce5-b1801e6c9d1a req-6c815901-fd9e-4769-b428-721ac5f356c4 tempest-TestMinimumBasicScenario-1068285597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:01:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-a68b043e-8c99-4fb3-8ce5-b1801e6c9d1a req-6c815901-fd9e-4769-b428-721ac5f356c4 tempest-TestMinimumBasicScenario-1068285597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:01:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-a68b043e-8c99-4fb3-8ce5-b1801e6c9d1a req-6c815901-fd9e-4769-b428-721ac5f356c4 tempest-TestMinimumBasicScenario-1068285597 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f748e000-55ff-46bd-9f7b-cca2d9960c6a', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 19:01:43 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-a68b043e-8c99-4fb3-8ce5-b1801e6c9d1a req-6c815901-fd9e-4769-b428-721ac5f356c4 tempest-TestMinimumBasicScenario-1068285597 None] attachment_update completed successfully. Sep 15 19:01:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:01:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:01:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:01:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:01:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:01:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:01:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:01:45 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:01:45 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:01:46 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Sep 15 19:01:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.300s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:01:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:01:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:01:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 19:01:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 19:01:53 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:01:53 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:02:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-dd93f179-7d8b-46f0-856f-eb271e96e47b req-edf403e9-c7d1-438e-85e9-16ce258ad705 tempest-TestMinimumBasicScenario-1068285597 None] Terminate volume connection completed successfully. Sep 15 19:02:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-dd93f179-7d8b-46f0-856f-eb271e96e47b req-edf403e9-c7d1-438e-85e9-16ce258ad705 tempest-TestMinimumBasicScenario-1068285597 None] Deleting attachment f748e000-55ff-46bd-9f7b-cca2d9960c6a. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 19:02:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Acquiring lock "cinder-0b5a9b9b-21cd-4d76-9657-2b929217d5ae-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:02:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Lock "cinder-0b5a9b9b-21cd-4d76-9657-2b929217d5ae-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:02:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Acquiring lock "cinder-quobyte-0b5a9b9b-21cd-4d76-9657-2b929217d5ae" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:02:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Lock "cinder-quobyte-0b5a9b9b-21cd-4d76-9657-2b929217d5ae" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:02:29 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d774fe1-b301-4e00-939e-58cfef3ee102]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:02:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:02:29 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae Sep 15 19:02:29 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:02:30 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae" returned: 0 in 0.379s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:02:30 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae Sep 15 19:02:30 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:02:30 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0b5a9b9b-21cd-4d76-9657-2b929217d5ae" returned: 0 in 0.262s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Lock "cinder-quobyte-0b5a9b9b-21cd-4d76-9657-2b929217d5ae" released by "delete_volume" :: held 0.684s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Created reservations ['b059f094-8879-487c-ba03-4381d71471af', '7106d2ee-f105-40e7-b21c-1fa25c440554', '52f78428-cc1a-4b0d-9475-bc74544f8bdc', '558867e3-2786-44d6-b3b5-7064d35a658b'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:02:30 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:02:30 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:02:30 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.257s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:02:30 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Deleted volume successfully. Sep 15 19:02:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d6d0a309-1150-4bb5-83a3-b52c807bfdcb tempest-TestMinimumBasicScenario-1068285597 None] Lock "cinder-0b5a9b9b-21cd-4d76-9657-2b929217d5ae-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:02:40 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:02:40 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:02:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:02:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:02:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:02:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:02:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:02:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:02:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:02:45 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:02:45 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:02:46 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 15 19:02:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.271s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:02:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:02:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:02:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 19:02:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Flow 'volume_create_manager' (c9f7cce1-9181-4c26-b28d-cc1cacff72b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcf6e35-9337-424b-ba09-0651093b70e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dcf6e35-9337-424b-ba09-0651093b70e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1000878109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589786a7-d95a-45d3-96ee-0f20774718ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0539b8b71e4ad484b5951df4ed2791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:03:03Z,use_quota=True,user_id='60015b30c48744e58dc0b778fa68356e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f94bd87-ac55-46c9-afd6-b4015965d4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f94bd87-ac55-46c9-afd6-b4015965d4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc4a725-1066-4ba5-9687-05f0cf606de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc4a725-1066-4ba5-9687-05f0cf606de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589786a7-d95a-45d3-96ee-0f20774718ab', 'volume_name': 'volume-589786a7-d95a-45d3-96ee-0f20774718ab', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cad34b-466a-4e6c-b78c-b1130ffa0e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cad34b-466a-4e6c-b78c-b1130ffa0e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96424da-901f-41ab-86a7-e1b1918ad272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Volume 589786a7-d95a-45d3-96ee-0f20774718ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589786a7-d95a-45d3-96ee-0f20774718ab', 'volume_size': 1} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1000878109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589786a7-d95a-45d3-96ee-0f20774718ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0539b8b71e4ad484b5951df4ed2791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:03:03Z,use_quota=True,user_id='60015b30c48744e58dc0b778fa68356e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Creating volume 589786a7-d95a-45d3-96ee-0f20774718ab {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:03:03 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:03 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab 1073741824 Sep 15 19:03:03 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Flow 'volume_create_manager' (9b8c7b23-5219-4a31-be70-507dd7f701e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33815376-ffd6-4e45-ae56-bc0dbe81503d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33815376-ffd6-4e45-ae56-bc0dbe81503d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-547945839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ec8bd1-d983-437b-ac7d-cfa383f5133a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0539b8b71e4ad484b5951df4ed2791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:03:04Z,use_quota=True,user_id='60015b30c48744e58dc0b778fa68356e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d078ef0d-a62b-43b2-9a2d-f139e3075407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d078ef0d-a62b-43b2-9a2d-f139e3075407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292b1f42-e05e-472d-aa27-3b23b2b53e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292b1f42-e05e-472d-aa27-3b23b2b53e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ec8bd1-d983-437b-ac7d-cfa383f5133a', 'volume_name': 'volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f71537b-e43e-454a-8376-fb27914c40f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f71537b-e43e-454a-8376-fb27914c40f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41fd11a-ff13-4c40-85b4-edd692ea118e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Volume c5ec8bd1-d983-437b-ac7d-cfa383f5133a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a', 'volume_size': 1} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:03:03 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab 1073741824" returned: 0 in 0.523s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:04 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab Sep 15 19:03:04 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:04 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab" returned: 0 in 0.264s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.467s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-547945839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ec8bd1-d983-437b-ac7d-cfa383f5133a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0539b8b71e4ad484b5951df4ed2791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:03:04Z,use_quota=True,user_id='60015b30c48744e58dc0b778fa68356e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Creating volume c5ec8bd1-d983-437b-ac7d-cfa383f5133a {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:03:04 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96424da-901f-41ab-86a7-e1b1918ad272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589786a7-d95a-45d3-96ee-0f20774718ab', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:04 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a 1073741824 Sep 15 19:03:04 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0025cb37-1273-43d9-ac79-ef4ad39cefff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Volume volume-589786a7-d95a-45d3-96ee-0f20774718ab (589786a7-d95a-45d3-96ee-0f20774718ab): created successfully Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0025cb37-1273-43d9-ac79-ef4ad39cefff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Flow 'volume_create_manager' (c9f7cce1-9181-4c26-b28d-cc1cacff72b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:03:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8d3647ff-0a1d-42e4-ae4e-efcc91ddf501 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Created volume successfully. Sep 15 19:03:04 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a 1073741824" returned: 0 in 0.477s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:04 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a Sep 15 19:03:04 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:05 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a" returned: 0 in 0.263s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:03:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:03:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41fd11a-ff13-4c40-85b4-edd692ea118e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af716a9-76d4-419b-86ff-d3268c182364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:03:05 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Volume volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a (c5ec8bd1-d983-437b-ac7d-cfa383f5133a): created successfully Sep 15 19:03:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af716a9-76d4-419b-86ff-d3268c182364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:03:05 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Flow 'volume_create_manager' (9b8c7b23-5219-4a31-be70-507dd7f701e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:03:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4cfccefd-6394-498d-ac13-ae881c114793 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Created volume successfully. Sep 15 19:03:15 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=4,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:03:15 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:03:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:03:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:03:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-4e77b348-8a8a-4210-97ec-c46490781ee2 req-c24d3d55-19c2-4273-bfb8-6d9560249e6a tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:03:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-4e77b348-8a8a-4210-97ec-c46490781ee2 req-c24d3d55-19c2-4273-bfb8-6d9560249e6a tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:03:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-4e77b348-8a8a-4210-97ec-c46490781ee2 req-c24d3d55-19c2-4273-bfb8-6d9560249e6a tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:03:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-4e77b348-8a8a-4210-97ec-c46490781ee2 req-c24d3d55-19c2-4273-bfb8-6d9560249e6a tempest-TestServerVolumeAttachmentScenario-1629411901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-589786a7-d95a-45d3-96ee-0f20774718ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd41f79b-56bc-467a-91c1-b9f2535c4dc7', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 19:03:34 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-4e77b348-8a8a-4210-97ec-c46490781ee2 req-c24d3d55-19c2-4273-bfb8-6d9560249e6a tempest-TestServerVolumeAttachmentScenario-1629411901 None] attachment_update completed successfully. Sep 15 19:03:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d2c8eb3f-4789-4e71-ae67-4e669ee3754d req-b6af3fc3-6911-4973-b093-0786f4b656c5 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:03:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d2c8eb3f-4789-4e71-ae67-4e669ee3754d req-b6af3fc3-6911-4973-b093-0786f4b656c5 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:03:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-d2c8eb3f-4789-4e71-ae67-4e669ee3754d req-b6af3fc3-6911-4973-b093-0786f4b656c5 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:03:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-d2c8eb3f-4789-4e71-ae67-4e669ee3754d req-b6af3fc3-6911-4973-b093-0786f4b656c5 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b72022a0-fcfe-4d74-b933-593c7a04e9e1', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 19:03:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-d2c8eb3f-4789-4e71-ae67-4e669ee3754d req-b6af3fc3-6911-4973-b093-0786f4b656c5 tempest-TestServerVolumeAttachmentScenario-1629411901 None] attachment_update completed successfully. Sep 15 19:03:39 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-447ad782-ca30-44e6-b6f5-28039954249c req-1f0bc663-10b9-4a44-9ef1-e234ba46dd15 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Terminate volume connection completed successfully. Sep 15 19:03:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-447ad782-ca30-44e6-b6f5-28039954249c req-1f0bc663-10b9-4a44-9ef1-e234ba46dd15 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Deleting attachment b72022a0-fcfe-4d74-b933-593c7a04e9e1. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 19:03:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-74b9461d-d8bf-4486-9808-a11fa5a73054 req-727ea70b-1995-4bcf-b7a0-c7b133c2f177 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Terminate volume connection completed successfully. Sep 15 19:03:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-74b9461d-d8bf-4486-9808-a11fa5a73054 req-727ea70b-1995-4bcf-b7a0-c7b133c2f177 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Deleting attachment dd41f79b-56bc-467a-91c1-b9f2535c4dc7. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "cinder-c5ec8bd1-d983-437b-ac7d-cfa383f5133a-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "cinder-c5ec8bd1-d983-437b-ac7d-cfa383f5133a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "cinder-quobyte-c5ec8bd1-d983-437b-ac7d-cfa383f5133a" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "cinder-quobyte-c5ec8bd1-d983-437b-ac7d-cfa383f5133a" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee3c9e9-8d7e-4a92-82e2-340c4192b8cc]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:45 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a Sep 15 19:03:45 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:45 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a" returned: 0 in 0.367s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:45 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a Sep 15 19:03:45 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:45 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c5ec8bd1-d983-437b-ac7d-cfa383f5133a" returned: 0 in 0.252s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "cinder-quobyte-c5ec8bd1-d983-437b-ac7d-cfa383f5133a" released by "delete_volume" :: held 0.657s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:45 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:03:45 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Created reservations ['b2836051-a3b7-45f5-8dd9-c3167fe4da94', 'c5800ea1-1e08-42d4-8ec3-e3cda703658e', '61b60cfb-d4b2-477a-a3aa-c8d8c1970066', '432f5486-e57e-4e48-9bd2-7b8e96f2b9dc'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:03:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:45 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:03:45 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:46 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.251s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 19:03:46 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.282s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:03:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Deleted volume successfully. Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "cinder-589786a7-d95a-45d3-96ee-0f20774718ab-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "cinder-589786a7-d95a-45d3-96ee-0f20774718ab-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b2954b88-e285-45e7-98e3-263fd6c26ef8 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "cinder-c5ec8bd1-d983-437b-ac7d-cfa383f5133a-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "cinder-quobyte-589786a7-d95a-45d3-96ee-0f20774718ab" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "cinder-quobyte-589786a7-d95a-45d3-96ee-0f20774718ab" acquired by "delete_volume" :: waited 0.014s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79ecafa-589e-4d6f-93ff-3efbd944722c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:46 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab Sep 15 19:03:46 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:46 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab" returned: 0 in 0.353s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:46 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab Sep 15 19:03:46 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:46 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-589786a7-d95a-45d3-96ee-0f20774718ab" returned: 0 in 0.245s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "cinder-quobyte-589786a7-d95a-45d3-96ee-0f20774718ab" released by "delete_volume" :: held 0.637s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Created reservations ['c6bbcb4f-cf3c-408a-88ab-47e18b03c9ea', 'd592002d-197b-4fcd-bdc4-d60e0241edb7', 'd8b2e4b6-aba2-43dc-88df-3650a4c4a349', '73dfc670-daf7-4532-bb75-e6f12d575d71'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:03:47 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:03:47 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:03:47 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.244s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:03:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Deleted volume successfully. Sep 15 19:03:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3d80d817-ae1c-499d-a121-c6a25eb84209 tempest-TestServerVolumeAttachmentScenario-1629411901 None] Lock "cinder-589786a7-d95a-45d3-96ee-0f20774718ab-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:03:57 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=28,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:03:57 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Flow 'volume_create_manager' (94dbc54a-c080-46e3-a3f0-40e162287abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0c85d4-6231-44e1-84f6-824ef3fd6f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0c85d4-6231-44e1-84f6-824ef3fd6f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1895115628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9f48c0-583c-43eb-bfc2-2c6adabb40f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b5c7571273404d80a5099e5ea69f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:04:20Z,use_quota=True,user_id='da85ace92f204fa6bbbc132c26c78ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07cff46-93a4-4fc7-a15c-eda06c05ff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07cff46-93a4-4fc7-a15c-eda06c05ff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698557ed-a71b-4a59-9633-ba8f80a11580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698557ed-a71b-4a59-9633-ba8f80a11580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9f48c0-583c-43eb-bfc2-2c6adabb40f2', 'volume_name': 'volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90741eae-6b3d-4643-81ae-a6d035253c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90741eae-6b3d-4643-81ae-a6d035253c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab3aee7-a7ef-46bc-a9ac-13ee7bee9ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:04:20 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Volume 4a9f48c0-583c-43eb-bfc2-2c6adabb40f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2', 'volume_size': 1} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:04:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1895115628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9f48c0-583c-43eb-bfc2-2c6adabb40f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b5c7571273404d80a5099e5ea69f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:04:20Z,use_quota=True,user_id='da85ace92f204fa6bbbc132c26c78ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Creating volume 4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:04:20 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:04:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:04:20 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 1073741824 Sep 15 19:04:20 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:04:21 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 15 19:04:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 1073741824" returned: 0 in 0.477s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:04:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:04:21 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 Sep 15 19:04:21 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:04:21 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Sep 15 19:04:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" returned: 0 in 0.265s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:04:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:04:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:04:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab3aee7-a7ef-46bc-a9ac-13ee7bee9ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:04:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1edd05-c3a3-486a-8b70-847267b0f1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:04:21 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Volume volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 (4a9f48c0-583c-43eb-bfc2-2c6adabb40f2): created successfully Sep 15 19:04:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1edd05-c3a3-486a-8b70-847267b0f1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:04:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Flow 'volume_create_manager' (94dbc54a-c080-46e3-a3f0-40e162287abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:04:21 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e9c43d08-9bd8-4120-a78d-a9859b6d582e tempest-TestStampPattern-1201352367 None] Created volume successfully. Sep 15 19:04:31 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=3 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:04:31 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:04:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:04:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:04:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:04:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:04:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:04:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:04:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:04:45 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:04:45 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:04:46 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Sep 15 19:04:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.265s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:04:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:04:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:04:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 19:04:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 19:04:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-ffd453f4-eb4b-4c7b-a9b1-3eb71660a10d req-14acd0c9-59f8-4071-8eb3-61863f85c9e2 tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:04:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-ffd453f4-eb4b-4c7b-a9b1-3eb71660a10d req-14acd0c9-59f8-4071-8eb3-61863f85c9e2 tempest-TestStampPattern-1201352367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:04:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-ffd453f4-eb4b-4c7b-a9b1-3eb71660a10d req-14acd0c9-59f8-4071-8eb3-61863f85c9e2 tempest-TestStampPattern-1201352367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:04:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-ffd453f4-eb4b-4c7b-a9b1-3eb71660a10d req-14acd0c9-59f8-4071-8eb3-61863f85c9e2 tempest-TestStampPattern-1201352367 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70b40fc4-746e-4dd0-a032-f5991c2fe50e', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 19:04:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-ffd453f4-eb4b-4c7b-a9b1-3eb71660a10d req-14acd0c9-59f8-4071-8eb3-61863f85c9e2 tempest-TestStampPattern-1201352367 None] attachment_update completed successfully. Sep 15 19:04:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-c7b60769-772e-4f4b-bc8c-3911c4249c76 req-8e2aebc2-f3e1-4719-896e-c4d6b42803e9 tempest-TestStampPattern-1201352367 None] Terminate volume connection completed successfully. Sep 15 19:04:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-c7b60769-772e-4f4b-bc8c-3911c4249c76 req-8e2aebc2-f3e1-4719-896e-c4d6b42803e9 tempest-TestStampPattern-1201352367 None] Deleting attachment 70b40fc4-746e-4dd0-a032-f5991c2fe50e. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 19:04:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:04:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:04:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Creating offline snapshot cf994237-f6cf-4b74-b9e7-465c1d3c985c of volume 4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:04:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d830f5-8a9a-4d4c-acfa-5728ee085e8d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:04:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:04:55 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 Sep 15 19:04:55 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:04:55 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Sep 15 19:04:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" returned: 0 in 0.362s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:04:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:04:55 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c 1G Sep 15 19:04:55 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:04:55 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 15 19:04:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c 1G" returned: 0 in 0.401s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:04:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:04:55 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c Sep 15 19:04:55 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:04:56 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Sep 15 19:04:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c" returned: 0 in 0.291s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:04:56 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c is being set with open permissions: ugo+rw Sep 15 19:04:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:04:56 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c Sep 15 19:04:56 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:04:56 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 15 19:04:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c" returned: 0 in 0.244s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:04:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:04:56 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.info Sep 15 19:04:56 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:04:56 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 15 19:04:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.info" returned: 0 in 0.256s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:04:56 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.info is being set with open permissions: ugo+rw Sep 15 19:04:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:04:56 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.info Sep 15 19:04:56 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:04:56 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 15 19:04:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.info" returned: 0 in 0.260s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:04:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:04:56 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-ebd92709-0b47-49d8-bc50-5262dce43e8c tempest-TestStampPattern-1201352367 None] Create snapshot completed successfully Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Flow 'volume_create_manager' (7e05d24d-ef62-4f0d-81c1-c8875b50e343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338247fa-4695-423f-bd9e-b9e719800b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338247fa-4695-423f-bd9e-b9e719800b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-997581767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d717dc7-f86f-45f9-9647-873fd760f787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b5c7571273404d80a5099e5ea69f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf994237-f6cf-4b74-b9e7-465c1d3c985c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:05:04Z,use_quota=True,user_id='da85ace92f204fa6bbbc132c26c78ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fe2f43-c418-4f53-a835-7078141f86e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fe2f43-c418-4f53-a835-7078141f86e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75804a5b-7ef4-49b6-8721-13003edeec62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75804a5b-7ef4-49b6-8721-13003edeec62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d717dc7-f86f-45f9-9647-873fd760f787', 'volume_name': 'volume-1d717dc7-f86f-45f9-9647-873fd760f787', 'volume_size': 1, 'snapshot_id': 'cf994237-f6cf-4b74-b9e7-465c1d3c985c'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbc1097-415f-4bc7-8e72-15512f995304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbc1097-415f-4bc7-8e72-15512f995304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa663e72-3b51-43d6-986a-aaf1ec90065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:05:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Volume 1d717dc7-f86f-45f9-9647-873fd760f787: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d717dc7-f86f-45f9-9647-873fd760f787', 'volume_size': 1, 'snapshot_id': 'cf994237-f6cf-4b74-b9e7-465c1d3c985c'} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Acquiring lock "cinder-quobyte-cf994237-f6cf-4b74-b9e7-465c1d3c985c-1d717dc7-f86f-45f9-9647-873fd760f787" by "_create_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-cf994237-f6cf-4b74-b9e7-465c1d3c985c-1d717dc7-f86f-45f9-9647-873fd760f787" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Creating volume 1d717dc7-f86f-45f9-9647-873fd760f787 from snapshot cf994237-f6cf-4b74-b9e7-465c1d3c985c {{(pid=86137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Acquiring lock "cinder-quobyte-1d717dc7-f86f-45f9-9647-873fd760f787" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-1d717dc7-f86f-45f9-9647-873fd760f787" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] snapshot: cf994237-f6cf-4b74-b9e7-465c1d3c985c, volume: 1d717dc7-f86f-45f9-9647-873fd760f787, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f145bb-c8b9-416a-b189-8f027fdf80a1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:05:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:04 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c Sep 15 19:05:04 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:04 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c" returned: 0 in 0.403s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:05:04 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2490696e-1558-4b9a-a2ce-86383cb65a9c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:05:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:04 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 Sep 15 19:05:04 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:04 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" returned: 0 in 0.413s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 19:05:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 19:05:04 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 19:05:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:04 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 Sep 15 19:05:04 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:13 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787" returned: 0 in 8.683s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2, size 1024.00 MB, duration 8.68 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 19:05:13 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Converted 1024.00 MB image at 117.92 MB/s Sep 15 19:05:13 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 is being set with open permissions: ugo+rw Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:13 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 Sep 15 19:05:13 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:13 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787" returned: 0 in 0.374s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-1d717dc7-f86f-45f9-9647-873fd760f787" released by "_copy_volume_from_snapshot" :: held 9.971s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-cf994237-f6cf-4b74-b9e7-465c1d3c985c-1d717dc7-f86f-45f9-9647-873fd760f787" released by "_create_volume_from_snapshot" :: held 10.040s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.056s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa663e72-3b51-43d6-986a-aaf1ec90065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d717dc7-f86f-45f9-9647-873fd760f787', 'volume_size': 1, 'snapshot_id': 'cf994237-f6cf-4b74-b9e7-465c1d3c985c'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7c1a80-87a9-4bc4-aef7-7dfaa750ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:05:13 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Volume volume-1d717dc7-f86f-45f9-9647-873fd760f787 (1d717dc7-f86f-45f9-9647-873fd760f787): created successfully Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7c1a80-87a9-4bc4-aef7-7dfaa750ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:05:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Flow 'volume_create_manager' (7e05d24d-ef62-4f0d-81c1-c8875b50e343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:05:13 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d8c309fb-95c8-4196-8877-73d48ce47402 tempest-TestStampPattern-1201352367 None] Created volume successfully. Sep 15 19:05:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:05:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:05:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-ca10d7f1-a1a8-4b3d-a230-0729a8e3ae0d req-8d6bcc15-cae2-4d40-a1fd-dfbbf8476556 tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:05:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-ca10d7f1-a1a8-4b3d-a230-0729a8e3ae0d req-8d6bcc15-cae2-4d40-a1fd-dfbbf8476556 tempest-TestStampPattern-1201352367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:05:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [req-ca10d7f1-a1a8-4b3d-a230-0729a8e3ae0d req-8d6bcc15-cae2-4d40-a1fd-dfbbf8476556 tempest-TestStampPattern-1201352367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:05:40 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-ca10d7f1-a1a8-4b3d-a230-0729a8e3ae0d req-8d6bcc15-cae2-4d40-a1fd-dfbbf8476556 tempest-TestStampPattern-1201352367 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b', 'name': 'volume-1d717dc7-f86f-45f9-9647-873fd760f787', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f525b6e-04c5-4b86-b1dc-84ab61060f96', 'enforce_multipath': True} {{(pid=86137) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 19:05:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-ca10d7f1-a1a8-4b3d-a230-0729a8e3ae0d req-8d6bcc15-cae2-4d40-a1fd-dfbbf8476556 tempest-TestStampPattern-1201352367 None] attachment_update completed successfully. Sep 15 19:05:42 devstack cinder-volume[86137]: INFO cinder.volume.manager [req-70de9d2b-7760-4acb-881b-71f5813b856b req-e76eace7-2dad-40fc-92e8-f4ffa291137c tempest-TestStampPattern-1201352367 None] Terminate volume connection completed successfully. Sep 15 19:05:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [req-70de9d2b-7760-4acb-881b-71f5813b856b req-e76eace7-2dad-40fc-92e8-f4ffa291137c tempest-TestStampPattern-1201352367 None] Deleting attachment 4f525b6e-04c5-4b86-b1dc-84ab61060f96. {{(pid=86137) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 19:05:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:05:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:05:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:05:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:05:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:05:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:05:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:45 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:05:45 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:46 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.242s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Acquiring lock "cinder-1d717dc7-f86f-45f9-9647-873fd760f787-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Lock "cinder-1d717dc7-f86f-45f9-9647-873fd760f787-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Acquiring lock "cinder-quobyte-1d717dc7-f86f-45f9-9647-873fd760f787" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-1d717dc7-f86f-45f9-9647-873fd760f787" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab9a58-7057-4f03-b33f-043173046e07]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:46 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 Sep 15 19:05:46 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:46 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787" returned: 0 in 0.382s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:47 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787 Sep 15 19:05:47 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:47 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1d717dc7-f86f-45f9-9647-873fd760f787" returned: 0 in 0.242s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-1d717dc7-f86f-45f9-9647-873fd760f787" released by "delete_volume" :: held 0.663s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Created reservations ['986f599f-4bdc-430a-83e3-6ccfd49120a4', 'ed5db724-b526-420d-b98f-a8eee2eafae7', 'c06d9f86-acc1-4f97-9be2-7dfb373e87ea', '187f6584-30c7-4277-8595-6ae878ce1484'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:47 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:05:47 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:47 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.242s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:05:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Deleted volume successfully. Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-69e285e3-f73d-4df5-94e1-3b1976d9800f tempest-TestStampPattern-1201352367 None] Lock "cinder-1d717dc7-f86f-45f9-9647-873fd760f787-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Acquiring lock "cinder-cf994237-f6cf-4b74-b9e7-465c1d3c985c-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Lock "cinder-cf994237-f6cf-4b74-b9e7-465c1d3c985c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Acquiring lock "cinder-quobyte-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Acquiring lock "cinder-quobyte-cf994237-f6cf-4b74-b9e7-465c1d3c985c" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-cf994237-f6cf-4b74-b9e7-465c1d3c985c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Deleting offline snapshot cf994237-f6cf-4b74-b9e7-465c1d3c985c of volume 4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] snapshot_file for this snap is: volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eac725b-00a4-4af6-b2c9-12f7bb4e7110]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:05:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:48 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c Sep 15 19:05:48 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:48 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c" returned: 0 in 0.369s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:05:48 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[90204275-b937-46f8-b692-22c1975c3b8e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:05:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:48 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 Sep 15 19:05:48 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:48 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" returned: 0 in 0.531s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:48 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c Sep 15 19:05:48 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:49 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c" returned: 0 in 0.324s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:49 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c Sep 15 19:05:49 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:49 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2.cf994237-f6cf-4b74-b9e7-465c1d3c985c" returned: 0 in 0.254s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-cf994237-f6cf-4b74-b9e7-465c1d3c985c" released by "_delete_snapshot" :: held 1.575s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:05:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" released by "delete_snapshot" :: held 1.596s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:05:49 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Created reservations ['03bf1627-7c62-478b-868a-3c2e2d3b4c09', 'f9ef51c3-b9ee-4525-8a9c-ef27e9b83e65', 'd49702df-aba8-4600-b5dc-2a82f6a93618', '35eb79c4-8565-40af-8a3d-20af55244123'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:05:49 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Delete snapshot completed successfully. Sep 15 19:05:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b8cda112-7827-4f36-bba4-c3170d63279d tempest-TestStampPattern-1201352367 None] Lock "cinder-cf994237-f6cf-4b74-b9e7-465c1d3c985c-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:05:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Acquiring lock "cinder-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:05:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Lock "cinder-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:05:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Acquiring lock "cinder-quobyte-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:05:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:05:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[290049c0-480e-4dc0-9d29-fde24d789a79]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:05:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:53 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 Sep 15 19:05:53 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:53 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" returned: 0 in 0.359s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:53 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2 Sep 15 19:05:53 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:54 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" returned: 0 in 0.242s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Lock "cinder-quobyte-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2" released by "delete_volume" :: held 0.656s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Created reservations ['f979b1e6-f79b-41cb-8e8a-9da0ab5588ae', '9f35df9b-ecfb-40bc-988a-b40e7352ed05', '7c8446a8-a804-416a-ab11-f8437bbc8c86', '8e3b756d-3091-4db6-b2a2-3cea749794df'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:05:54 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:05:54 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:05:54 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.243s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:05:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Deleted volume successfully. Sep 15 19:05:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-512013ae-d36a-4e02-86f1-3dd8cb589fe5 tempest-TestStampPattern-1201352367 None] Lock "cinder-4a9f48c0-583c-43eb-bfc2-2c6adabb40f2-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:04 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=22,cinder:UPDATE=30,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:06:04 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Flow 'volume_create_manager' (08aff864-bb58-4b64-8be9-f13e81d09693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14ec2d8-85c0-40f1-b1bd-a23071d46b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14ec2d8-85c0-40f1-b1bd-a23071d46b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25691650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134aacda-a9b6-45ca-8f11-e63505e64d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afeb771d6c44f37b04184ca6dd245a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:06Z,use_quota=True,user_id='c1a8104c3b2546b3a0159436ab669d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3834f4ee-0898-4831-832a-0074e453261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3834f4ee-0898-4831-832a-0074e453261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e004cfc-29b4-4493-a650-f13f3e3bcc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e004cfc-29b4-4493-a650-f13f3e3bcc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '134aacda-a9b6-45ca-8f11-e63505e64d83', 'volume_name': 'volume-134aacda-a9b6-45ca-8f11-e63505e64d83', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac615be0-5b0d-44f1-a5f7-ab593da9dd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac615be0-5b0d-44f1-a5f7-ab593da9dd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2dc25d-d4a0-4764-8332-3a64667255c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:06 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Volume 134aacda-a9b6-45ca-8f11-e63505e64d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-134aacda-a9b6-45ca-8f11-e63505e64d83', 'volume_size': 1} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25691650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=134aacda-a9b6-45ca-8f11-e63505e64d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afeb771d6c44f37b04184ca6dd245a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:06Z,use_quota=True,user_id='c1a8104c3b2546b3a0159436ab669d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Creating volume 134aacda-a9b6-45ca-8f11-e63505e64d83 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:06 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:06 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83 1073741824 Sep 15 19:06:06 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:06 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83 1073741824" returned: 0 in 0.393s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:07 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83 Sep 15 19:06:07 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:07 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83" returned: 0 in 0.230s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2dc25d-d4a0-4764-8332-3a64667255c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-134aacda-a9b6-45ca-8f11-e63505e64d83', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91a5d37-60ad-40f9-a7e0-46324c5b31a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Volume volume-134aacda-a9b6-45ca-8f11-e63505e64d83 (134aacda-a9b6-45ca-8f11-e63505e64d83): created successfully Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91a5d37-60ad-40f9-a7e0-46324c5b31a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Flow 'volume_create_manager' (08aff864-bb58-4b64-8be9-f13e81d09693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-41be417f-f513-4773-b568-e507d9c49535 tempest-ProjectReaderTests-155705910 None] Created volume successfully. Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Acquiring lock "cinder-134aacda-a9b6-45ca-8f11-e63505e64d83-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Lock "cinder-134aacda-a9b6-45ca-8f11-e63505e64d83-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Acquiring lock "cinder-quobyte-134aacda-a9b6-45ca-8f11-e63505e64d83" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Lock "cinder-quobyte-134aacda-a9b6-45ca-8f11-e63505e64d83" acquired by "delete_volume" :: waited 0.013s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df41e99-dfdb-400e-a142-bddd1bfa60ac]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:07 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83 Sep 15 19:06:07 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:08 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83" returned: 0 in 0.348s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:08 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83 Sep 15 19:06:08 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:08 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-134aacda-a9b6-45ca-8f11-e63505e64d83" returned: 0 in 0.237s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Lock "cinder-quobyte-134aacda-a9b6-45ca-8f11-e63505e64d83" released by "delete_volume" :: held 0.622s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Created reservations ['648086fb-84ae-4d4d-8c51-44925188679a', 'bb4ca589-6ca5-49fe-8bcb-d2de19feeac5', '6c39da1f-7b5a-4e76-a7ae-621a6162509d', '9057a52b-a45d-42eb-8bec-ca11e40fbd60'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:08 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:08 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:08 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.241s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Deleted volume successfully. Sep 15 19:06:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a87c776f-e524-4b9d-b9ee-02a2e1c4d69b tempest-ProjectReaderTests-155705910 None] Lock "cinder-134aacda-a9b6-45ca-8f11-e63505e64d83-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Flow 'volume_create_manager' (55cc2fe5-fb78-49eb-ad74-3da4c4c8c8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9813ca0a-3dd4-4b0c-b637-8780d61875fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9813ca0a-3dd4-4b0c-b637-8780d61875fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918183596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc1e7cb-aea4-4aed-9936-74e681b13c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afeb771d6c44f37b04184ca6dd245a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:09Z,use_quota=True,user_id='c1a8104c3b2546b3a0159436ab669d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4383b99e-b5a8-49d1-ae8c-cc11d5909bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4383b99e-b5a8-49d1-ae8c-cc11d5909bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6017d94b-bc2c-4bac-aa21-4301280d4737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6017d94b-bc2c-4bac-aa21-4301280d4737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc1e7cb-aea4-4aed-9936-74e681b13c62', 'volume_name': 'volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb02db02-1a09-4f93-a8aa-fff1cf881671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb02db02-1a09-4f93-a8aa-fff1cf881671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73a90f7-8802-4b0f-98bc-0a732290d910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:09 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Volume cbc1e7cb-aea4-4aed-9936-74e681b13c62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62', 'volume_size': 1} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918183596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc1e7cb-aea4-4aed-9936-74e681b13c62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8afeb771d6c44f37b04184ca6dd245a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:09Z,use_quota=True,user_id='c1a8104c3b2546b3a0159436ab669d93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Creating volume cbc1e7cb-aea4-4aed-9936-74e681b13c62 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:09 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:09 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 1073741824 Sep 15 19:06:09 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:09 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 1073741824" returned: 0 in 0.397s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:09 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 Sep 15 19:06:09 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:09 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62" returned: 0 in 0.242s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73a90f7-8802-4b0f-98bc-0a732290d910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f60f251-0fdb-45b0-bb31-b40dc7dff77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:10 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Volume volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 (cbc1e7cb-aea4-4aed-9936-74e681b13c62): created successfully Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f60f251-0fdb-45b0-bb31-b40dc7dff77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Flow 'volume_create_manager' (55cc2fe5-fb78-49eb-ad74-3da4c4c8c8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:10 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7f37d80a-b5bb-4db5-ba2d-f8e8aa58d44c tempest-ProjectReaderTests-155705910 None] Created volume successfully. Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Acquiring lock "cinder-cbc1e7cb-aea4-4aed-9936-74e681b13c62-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Lock "cinder-cbc1e7cb-aea4-4aed-9936-74e681b13c62-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Acquiring lock "cinder-quobyte-cbc1e7cb-aea4-4aed-9936-74e681b13c62" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Lock "cinder-quobyte-cbc1e7cb-aea4-4aed-9936-74e681b13c62" acquired by "delete_volume" :: waited 0.014s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db9acaf-6e25-411e-98dd-e93b9c7902bc]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:10 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 Sep 15 19:06:10 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:10 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62" returned: 0 in 0.379s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:10 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62 Sep 15 19:06:10 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:10 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-cbc1e7cb-aea4-4aed-9936-74e681b13c62" returned: 0 in 0.246s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Lock "cinder-quobyte-cbc1e7cb-aea4-4aed-9936-74e681b13c62" released by "delete_volume" :: held 0.665s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Created reservations ['3fb0903f-61b9-4c06-9853-c4e2e4477277', '3e199e3b-acbe-49f2-9476-a335d2dca27a', '04c2e32a-bb3b-4073-9421-011abf19aaf6', '7f73284e-ba70-4045-b7a3-6419727d9f55'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:11 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:11 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:11 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.241s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Deleted volume successfully. Sep 15 19:06:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-701db8ae-33f5-463f-b878-422f0bef5504 tempest-ProjectReaderTests-155705910 None] Lock "cinder-cbc1e7cb-aea4-4aed-9936-74e681b13c62-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:21 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=21,cinder:SELECT=14,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:06:21 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=14,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=3 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (a84fb5fb-706e-4f2c-88cc-aeedf1afe18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986e5375-2d5e-4be9-a761-b57a6ce9d530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986e5375-2d5e-4be9-a761-b57a6ce9d530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-231375625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ff8d2e-9a89-4350-a041-9205a8d95799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:28Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdb8215-d64d-46a4-a810-6786d19448ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bdb8215-d64d-46a4-a810-6786d19448ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94bc775-6508-4ea1-9450-ec82ad6cf534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94bc775-6508-4ea1-9450-ec82ad6cf534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ff8d2e-9a89-4350-a041-9205a8d95799', 'volume_name': 'volume-11ff8d2e-9a89-4350-a041-9205a8d95799', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d69fca-5e51-4a53-926b-db30c997ebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d69fca-5e51-4a53-926b-db30c997ebc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a638de-0674-4918-a889-b8cce20470f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:27 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume 11ff8d2e-9a89-4350-a041-9205a8d95799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ff8d2e-9a89-4350-a041-9205a8d95799', 'volume_size': 1} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-231375625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ff8d2e-9a89-4350-a041-9205a8d95799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:28Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Creating volume 11ff8d2e-9a89-4350-a041-9205a8d95799 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:27 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:27 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799 1073741824 Sep 15 19:06:27 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (05ed9862-f0e0-4605-bcdd-51307c1689b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f0615e-4362-41b8-99f5-9e9c652ffa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f0615e-4362-41b8-99f5-9e9c652ffa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1146915428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3348839b-3c52-4fda-8bff-129dee12ac8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:28Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5110c5cc-4688-494d-a3ed-517d9ea0ee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5110c5cc-4688-494d-a3ed-517d9ea0ee97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611e6edf-82ba-4c30-8fc3-c8c17e9d1910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611e6edf-82ba-4c30-8fc3-c8c17e9d1910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3348839b-3c52-4fda-8bff-129dee12ac8b', 'volume_name': 'volume-3348839b-3c52-4fda-8bff-129dee12ac8b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1d6f43-15dc-4e46-a3f0-7b1124316c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1d6f43-15dc-4e46-a3f0-7b1124316c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03abb277-9ae8-4b04-855c-416f9f646193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume 3348839b-3c52-4fda-8bff-129dee12ac8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3348839b-3c52-4fda-8bff-129dee12ac8b', 'volume_size': 1} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:28 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799 1073741824" returned: 0 in 0.525s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:28 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799 Sep 15 19:06:28 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:28 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799" returned: 0 in 0.327s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.455s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1146915428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3348839b-3c52-4fda-8bff-129dee12ac8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:28Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Creating volume 3348839b-3c52-4fda-8bff-129dee12ac8b {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:28 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:28 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b 1073741824 Sep 15 19:06:28 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a638de-0674-4918-a889-b8cce20470f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ff8d2e-9a89-4350-a041-9205a8d95799', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36266cc-f5e4-4896-aea8-6abb59aa9f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume volume-11ff8d2e-9a89-4350-a041-9205a8d95799 (11ff8d2e-9a89-4350-a041-9205a8d95799): created successfully Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36266cc-f5e4-4896-aea8-6abb59aa9f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (a84fb5fb-706e-4f2c-88cc-aeedf1afe18a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0ed384c0-d4d5-4612-a61b-6c965d7e4828 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created volume successfully. Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (f799a932-a1aa-4316-ac2c-5197dccd86ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad76801c-a961-4f76-84ec-fd82196509ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad76801c-a961-4f76-84ec-fd82196509ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701663005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91631118-8c0a-470d-9651-254a1cb2bee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:29Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79815129-dd09-4802-b3a5-d11ce3697762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79815129-dd09-4802-b3a5-d11ce3697762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bbf574-0778-4d13-ba88-17134f0d9c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5bbf574-0778-4d13-ba88-17134f0d9c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91631118-8c0a-470d-9651-254a1cb2bee9', 'volume_name': 'volume-91631118-8c0a-470d-9651-254a1cb2bee9', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7036fec7-11a2-4578-b80a-1a65f72b0728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7036fec7-11a2-4578-b80a-1a65f72b0728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c950ad1e-2ca3-467f-9673-010d09fd2297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:28 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Volume 91631118-8c0a-470d-9651-254a1cb2bee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91631118-8c0a-470d-9651-254a1cb2bee9', 'volume_size': 1} Sep 15 19:06:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:29 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b 1073741824" returned: 0 in 0.525s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:29 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b Sep 15 19:06:29 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:29 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b" returned: 0 in 0.263s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-701663005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91631118-8c0a-470d-9651-254a1cb2bee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:29Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Creating volume 91631118-8c0a-470d-9651-254a1cb2bee9 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:29 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03abb277-9ae8-4b04-855c-416f9f646193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3348839b-3c52-4fda-8bff-129dee12ac8b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:29 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 1073741824 Sep 15 19:06:29 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca695c8e-deb4-41ad-a192-d651dd4a574f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:29 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume volume-3348839b-3c52-4fda-8bff-129dee12ac8b (3348839b-3c52-4fda-8bff-129dee12ac8b): created successfully Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca695c8e-deb4-41ad-a192-d651dd4a574f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (05ed9862-f0e0-4605-bcdd-51307c1689b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c2a327bd-1d99-4181-a00a-3dd7c5f24887 tempest-CreateVolumesFromSnapshotTest-971445185 None] Created volume successfully. Sep 15 19:06:30 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 1073741824" returned: 0 in 0.612s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:30 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 Sep 15 19:06:30 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (9cce732e-d5c8-4a69-bff4-1cf4bca6bc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7ee11e-73d9-474f-b996-213c859320e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7ee11e-73d9-474f-b996-213c859320e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670651813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c7b05e-c6fb-4147-8e92-e2a30eb73256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:30Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36b31ff-dc54-4edb-b6cf-8281d145cf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36b31ff-dc54-4edb-b6cf-8281d145cf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d5d797-6198-44be-94a9-22d6844ef53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d5d797-6198-44be-94a9-22d6844ef53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c7b05e-c6fb-4147-8e92-e2a30eb73256', 'volume_name': 'volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c227964-bbd8-4278-9f44-e44adcc520bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c227964-bbd8-4278-9f44-e44adcc520bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec48a071-1b60-4823-a41a-39ee61132007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume 74c7b05e-c6fb-4147-8e92-e2a30eb73256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256', 'volume_size': 1} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:30 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9" returned: 0 in 0.336s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670651813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c7b05e-c6fb-4147-8e92-e2a30eb73256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:30Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Creating volume 74c7b05e-c6fb-4147-8e92-e2a30eb73256 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:30 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c950ad1e-2ca3-467f-9673-010d09fd2297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91631118-8c0a-470d-9651-254a1cb2bee9', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878c7aaa-e598-442d-8815-df959ebbd2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 1073741824 Sep 15 19:06:30 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:30 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Volume volume-91631118-8c0a-470d-9651-254a1cb2bee9 (91631118-8c0a-470d-9651-254a1cb2bee9): created successfully Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878c7aaa-e598-442d-8815-df959ebbd2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (f799a932-a1aa-4316-ac2c-5197dccd86ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:30 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-50b5d5a9-5e03-425b-a9c4-4eeb5cce8b4e tempest-ProjectReaderTests-1438187467 None] Created volume successfully. Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (9fd8276e-5693-417b-9c56-f278bb3cc6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8292c6-72b7-4fbc-a19c-161277393b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab8292c6-72b7-4fbc-a19c-161277393b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1204406961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da48a090-a476-41d2-8c72-582a0735db8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:31Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fa302d-c87e-4312-b3f0-044bd8da73d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fa302d-c87e-4312-b3f0-044bd8da73d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b7eee6-c2a7-4e4e-b528-ca6304fafac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b7eee6-c2a7-4e4e-b528-ca6304fafac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da48a090-a476-41d2-8c72-582a0735db8b', 'volume_name': 'volume-da48a090-a476-41d2-8c72-582a0735db8b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33a9a3f-0d1f-402d-8458-94c9a0b4b5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33a9a3f-0d1f-402d-8458-94c9a0b4b5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b97fd58-2687-4684-9f84-66dcda5c0fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:30 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume da48a090-a476-41d2-8c72-582a0735db8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da48a090-a476-41d2-8c72-582a0735db8b', 'volume_size': 1} Sep 15 19:06:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:31 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 1073741824" returned: 0 in 0.722s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:31 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 Sep 15 19:06:31 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (0f4714ca-6844-4504-9a6e-3d8733a1284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c324456-5de7-4de6-830f-4d280afd932f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c324456-5de7-4de6-830f-4d280afd932f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859861063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2116c385-5670-4d3e-abb2-4aa9cfe19b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:31Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4139103-cf55-4db9-b4fc-8031557ed111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4139103-cf55-4db9-b4fc-8031557ed111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302f4b92-a6b8-45b5-b005-e8db22db1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302f4b92-a6b8-45b5-b005-e8db22db1506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2116c385-5670-4d3e-abb2-4aa9cfe19b77', 'volume_name': 'volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac84f1ce-8528-4daa-a889-3365788db843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac84f1ce-8528-4daa-a889-3365788db843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b2e6a9-6b12-48c2-a470-544a89d27427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume 2116c385-5670-4d3e-abb2-4aa9cfe19b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77', 'volume_size': 1} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:31 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256" returned: 0 in 0.363s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.164s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec48a071-1b60-4823-a41a-39ee61132007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4978d14f-f27c-4b2f-98f1-8f556b7a6397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Creating offline snapshot 342d2c20-4195-4790-aa51-aa29e7b764ee of volume 3348839b-3c52-4fda-8bff-129dee12ac8b {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:06:31 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 (74c7b05e-c6fb-4147-8e92-e2a30eb73256): created successfully Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4978d14f-f27c-4b2f-98f1-8f556b7a6397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (9cce732e-d5c8-4a69-bff4-1cf4bca6bc4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[896f4916-456e-4dba-9455-2e1a3406b45c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3efa87be-0ca6-4aef-b836-4a20e56719a2 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created volume successfully. Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (705397b2-cc7d-4fa9-96f5-02718401670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2532e8-90db-4ee6-b052-6ec825ccacd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb2532e8-90db-4ee6-b052-6ec825ccacd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1352366938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370d8197-2e38-46df-8d79-11e945cba852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:32Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded5e518-2c39-4145-96f2-572a919c8948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded5e518-2c39-4145-96f2-572a919c8948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6ae9e3-4e32-4748-91ef-1c3998219ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b Sep 15 19:06:31 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6ae9e3-4e32-4748-91ef-1c3998219ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '370d8197-2e38-46df-8d79-11e945cba852', 'volume_name': 'volume-370d8197-2e38-46df-8d79-11e945cba852', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce63de6-d4da-4266-bdc8-838969db4ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce63de6-d4da-4266-bdc8-838969db4ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19802684-1f4c-40d0-bc2a-45bec7039d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:31 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume 370d8197-2e38-46df-8d79-11e945cba852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-370d8197-2e38-46df-8d79-11e945cba852', 'volume_size': 1} Sep 15 19:06:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:32 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b" returned: 0 in 0.438s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:32 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee 1G Sep 15 19:06:32 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (b4b9137c-d488-4171-8794-a36d41193e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1a3de-ad8f-4e16-8e96-5cac1abc4f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1a3de-ad8f-4e16-8e96-5cac1abc4f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-748464629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9d375f-3249-45ad-bda1-8f54cba5dfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:32Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6758588-5065-4a1f-af6d-31d976bed45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6758588-5065-4a1f-af6d-31d976bed45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17151af1-d591-4fdf-aafb-d09f5f93eee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17151af1-d591-4fdf-aafb-d09f5f93eee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be9d375f-3249-45ad-bda1-8f54cba5dfc3', 'volume_name': 'volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4b1f7d-e2f2-4bde-be2e-ee6ab985a0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4b1f7d-e2f2-4bde-be2e-ee6ab985a0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995140ee-e6d8-4e41-ad1e-4615e99efa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:32 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume be9d375f-3249-45ad-bda1-8f54cba5dfc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3', 'volume_size': 1} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:32 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee 1G" returned: 0 in 0.480s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3348839b-3c52-4fda-8bff-129dee12ac8b -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:32 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3348839b-3c52-4fda-8bff-129dee12ac8b -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee Sep 15 19:06:32 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Flow 'volume_create_manager' (7581d2ca-598d-4b26-8ad6-688b960e9849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8003bd-d36d-4f2c-84b0-a0bfad73a1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8003bd-d36d-4f2c-84b0-a0bfad73a1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67593549-c841-4282-ab0d-b1039feb6bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3d678683d7482fa2f53418e53cf2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:33Z,use_quota=True,user_id='3a3dea60a2884e34b4fcd863bef2bf74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6b29ae3-4f93-48fc-8057-ac12cb353f38),volume_type_id=e6b29ae3-4f93-48fc-8057-ac12cb353f38)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ce7a25-5313-4932-96b7-c161593250e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ce7a25-5313-4932-96b7-c161593250e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707ef01f-1ffa-4f85-87b1-d640753ce36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 19:06:32 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3348839b-3c52-4fda-8bff-129dee12ac8b -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee" returned: 0 in 0.344s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:32 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee is being set with open permissions: ugo+rw Sep 15 19:06:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:33 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee Sep 15 19:06:33 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707ef01f-1ffa-4f85-87b1-d640753ce36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '67593549-c841-4282-ab0d-b1039feb6bad', 'volume_name': 'volume-67593549-c841-4282-ab0d-b1039feb6bad', 'volume_size': 1, 'image_id': 'b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edbd87011c6d269738d9ec60da7ac039', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7f3d678683d7482fa2f53418e53cf2c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ca2a8f2a77a38bb94c1fe5817e8c79de5dffa24dcc6f8e9ae9eeba08e3efc9a19d13a1c8a40c4eaeef5e78dd37077a2a8969571d01dc6ea44c4fda291357b8e', 'id': 'b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'created_at': datetime.datetime(2026, 9, 15, 17, 6, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 17, 6, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6b74479-374f-4fab-ba7e-0d1dca1fa1a3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867da89a-2445-4af3-8b11-d7804eb1d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867da89a-2445-4af3-8b11-d7804eb1d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15ee6f9-e8ec-434b-a1f5-55e710374a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:33 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Volume 67593549-c841-4282-ab0d-b1039feb6bad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-67593549-c841-4282-ab0d-b1039feb6bad', 'volume_size': 1, 'image_id': 'b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edbd87011c6d269738d9ec60da7ac039', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7f3d678683d7482fa2f53418e53cf2c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ca2a8f2a77a38bb94c1fe5817e8c79de5dffa24dcc6f8e9ae9eeba08e3efc9a19d13a1c8a40c4eaeef5e78dd37077a2a8969571d01dc6ea44c4fda291357b8e', 'id': 'b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'created_at': datetime.datetime(2026, 9, 15, 17, 6, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 17, 6, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6b74479-374f-4fab-ba7e-0d1dca1fa1a3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Trying to clone 67593549-c841-4282-ab0d-b1039feb6bad from image b6b74479-374f-4fab-ba7e-0d1dca1fa1a3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 19:06:33 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Image download 0.00 MB at 0.00 MB/s Sep 15 19:06:33 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee" returned: 0 in 0.267s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[76964def-3566-4989-946c-8f269ec09b4d]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:33 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.info Sep 15 19:06:33 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:33 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD Sep 15 19:06:33 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:33 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.info" returned: 0 in 0.277s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:33 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.info is being set with open permissions: ugo+rw Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:33 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.info Sep 15 19:06:33 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:33 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:33 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD Sep 15 19:06:33 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:33 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.info" returned: 0 in 0.258s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1204406961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da48a090-a476-41d2-8c72-582a0735db8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:31Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Creating volume da48a090-a476-41d2-8c72-582a0735db8b {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:33 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:33 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b 1073741824 Sep 15 19:06:33 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-2c5a2000-b2ef-4727-b875-726eee87b05b tempest-CreateVolumesFromSnapshotTest-971445185 None] Create snapshot completed successfully Sep 15 19:06:33 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD" returned: 1 in 0.322s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 19:06:33 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Temporary image b6b74479-374f-4fab-ba7e-0d1dca1fa1a3 is fetched for user 3a3dea60a2884e34b4fcd863bef2bf74. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f861896-fa32-4a80-863c-455be6503f5d]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:34 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD Sep 15 19:06:34 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:34 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b 1073741824" returned: 0 in 0.473s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:34 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:34 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b Sep 15 19:06:34 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:34 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD Sep 15 19:06:34 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:34 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b" returned: 0 in 0.256s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.278s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b97fd58-2687-4684-9f84-66dcda5c0fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da48a090-a476-41d2-8c72-582a0735db8b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a404de6-fb2f-4f2b-86da-8c2cbd082f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Creating offline snapshot 7ed59f24-0143-453b-87b8-c1f063675427 of volume 91631118-8c0a-470d-9651-254a1cb2bee9 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:06:34 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume volume-da48a090-a476-41d2-8c72-582a0735db8b (da48a090-a476-41d2-8c72-582a0735db8b): created successfully Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a404de6-fb2f-4f2b-86da-8c2cbd082f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (9fd8276e-5693-417b-9c56-f278bb3cc6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c4aa65-ed93-48f6-a2c2-8ede9b055cc5]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:34 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c006b778-0e93-421c-af85-b0bff467f40f tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created volume successfully. Sep 15 19:06:34 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 19:06:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:34 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 Sep 15 19:06:34 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:35 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9" returned: 0 in 0.442s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:35 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 1G Sep 15 19:06:35 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (31de96f1-4cb9-44c6-be32-08b6e3701d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b74a3b-0c4e-4f6d-bad2-d99a981ebeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b74a3b-0c4e-4f6d-bad2-d99a981ebeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1321465888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db0fdef-b7aa-436b-8559-42de9a165ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:35Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a4c840-1e90-4670-8acf-cb45c6efbfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70a4c840-1e90-4670-8acf-cb45c6efbfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0b02bf-4d40-4101-8a7b-13d82baf5294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0b02bf-4d40-4101-8a7b-13d82baf5294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db0fdef-b7aa-436b-8559-42de9a165ba5', 'volume_name': 'volume-0db0fdef-b7aa-436b-8559-42de9a165ba5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ae91ef-f2dd-45d7-a745-09e8c151b566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ae91ef-f2dd-45d7-a745-09e8c151b566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6cb8a6-a03e-4721-970c-3415907cfb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume 0db0fdef-b7aa-436b-8559-42de9a165ba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db0fdef-b7aa-436b-8559-42de9a165ba5', 'volume_size': 1} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (c010ae25-3201-4b29-b5d5-d17445ccae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2cd32b-04ae-4350-9b25-69ff38826eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2cd32b-04ae-4350-9b25-69ff38826eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786567004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90b1bc5-4fd1-4144-a3a9-bd8218517f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:35Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2cefa5-956a-40fd-b57e-c76b79cb5033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2cefa5-956a-40fd-b57e-c76b79cb5033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2413039-d555-4e5b-87a0-775b2bccd257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2413039-d555-4e5b-87a0-775b2bccd257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90b1bc5-4fd1-4144-a3a9-bd8218517f1b', 'volume_name': 'volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2065cb2f-c8aa-4c6e-828e-cc5a9a287ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2065cb2f-c8aa-4c6e-828e-cc5a9a287ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1482273e-2c48-4c07-98eb-14689b1b1e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume a90b1bc5-4fd1-4144-a3a9-bd8218517f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b', 'volume_size': 1} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:35 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 1G" returned: 0 in 0.520s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91631118-8c0a-470d-9651-254a1cb2bee9 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:35 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91631118-8c0a-470d-9651-254a1cb2bee9 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 Sep 15 19:06:35 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (fd832e2d-f828-4c49-93c6-cffa3152ee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6e8991-9f4e-4c89-8ded-2e6844985515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6e8991-9f4e-4c89-8ded-2e6844985515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1653285637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6375278-1efe-4e54-b7d8-c28dde3da67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:36Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4ac785-46fb-46ad-a0f8-d93eacb19649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4ac785-46fb-46ad-a0f8-d93eacb19649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:35 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cf2dae-e293-402e-8406-bac19a3d6ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cf2dae-e293-402e-8406-bac19a3d6ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6375278-1efe-4e54-b7d8-c28dde3da67d', 'volume_name': 'volume-f6375278-1efe-4e54-b7d8-c28dde3da67d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a03144-d6e8-4e8a-98a6-c25882404201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a03144-d6e8-4e8a-98a6-c25882404201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef3fbf2-c192-4c3e-892c-47a22f5d2641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume f6375278-1efe-4e54-b7d8-c28dde3da67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6375278-1efe-4e54-b7d8-c28dde3da67d', 'volume_size': 1} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:36 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91631118-8c0a-470d-9651-254a1cb2bee9 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427" returned: 0 in 0.384s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:36 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 is being set with open permissions: ugo+rw Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:36 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 Sep 15 19:06:36 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (08bff743-1c20-4db9-9cff-15e397ec2144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fd69d1-8128-4927-854d-405f4fdeb042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fd69d1-8128-4927-854d-405f4fdeb042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-336020755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2930ecc-e5dc-4220-9204-e30cdd12b6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:36Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e837ba61-df0b-44d6-a703-90c4d4ad649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e837ba61-df0b-44d6-a703-90c4d4ad649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506ebdb8-d1bd-4173-a151-5bd9ed3223eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506ebdb8-d1bd-4173-a151-5bd9ed3223eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2930ecc-e5dc-4220-9204-e30cdd12b6c7', 'volume_name': 'volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea973580-7061-4d51-94a9-d22a75c6ac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea973580-7061-4d51-94a9-d22a75c6ac0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4545c38-9ee6-483e-8c81-2112722e28bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume f2930ecc-e5dc-4220-9204-e30cdd12b6c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7', 'volume_size': 1} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427" returned: 0 in 0.319s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:36 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.info Sep 15 19:06:36 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:36 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (28766e09-7996-4406-9fda-bec5154d2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021bba35-5fa1-4833-a29a-104d4c8d9a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.info" returned: 0 in 0.291s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:36 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.info is being set with open permissions: ugo+rw Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021bba35-5fa1-4833-a29a-104d4c8d9a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1793320275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ec3d3f-8aef-4702-8b69-7fdb8511880f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:37Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.info Sep 15 19:06:36 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d580f1-7b62-4e20-8498-0e222fde389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d580f1-7b62-4e20-8498-0e222fde389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850f0fcd-2b07-459e-baa2-ce84c3d577f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850f0fcd-2b07-459e-baa2-ce84c3d577f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ec3d3f-8aef-4702-8b69-7fdb8511880f', 'volume_name': 'volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109e01c7-0cd6-4cd1-81d2-4a50a89bdd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (109e01c7-0cd6-4cd1-81d2-4a50a89bdd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01543f32-4344-4c82-b637-5d002c8cfba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:36 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume 81ec3d3f-8aef-4702-8b69-7fdb8511880f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f', 'volume_size': 1} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:36 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.info" returned: 0 in 0.245s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.424s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859861063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2116c385-5670-4d3e-abb2-4aa9cfe19b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:31Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Creating volume 2116c385-5670-4d3e-abb2-4aa9cfe19b77 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:36 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:37 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 1073741824 Sep 15 19:06:37 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-533efd7f-0a08-4812-a5ee-56b21bf700d2 tempest-ProjectReaderTests-1438187467 None] Create snapshot completed successfully Sep 15 19:06:37 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 1073741824" returned: 0 in 0.422s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:37 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 Sep 15 19:06:37 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-7ed59f24-0143-453b-87b8-c1f063675427-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-7ed59f24-0143-453b-87b8-c1f063675427-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-91631118-8c0a-470d-9651-254a1cb2bee9" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-91631118-8c0a-470d-9651-254a1cb2bee9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-7ed59f24-0143-453b-87b8-c1f063675427" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-7ed59f24-0143-453b-87b8-c1f063675427" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Deleting offline snapshot 7ed59f24-0143-453b-87b8-c1f063675427 of volume 91631118-8c0a-470d-9651-254a1cb2bee9 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] snapshot_file for this snap is: volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7cd816-207c-4b01-b6ae-d2647457e6b8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:37 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77" returned: 0 in 0.280s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.825s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1352366938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=370d8197-2e38-46df-8d79-11e945cba852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:32Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Creating volume 370d8197-2e38-46df-8d79-11e945cba852 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:37 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08b2e6a9-6b12-48c2-a470-544a89d27427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:37 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852 1073741824 Sep 15 19:06:37 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d097ce-2231-43b6-8e8b-48bddbcbe588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:37 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 (2116c385-5670-4d3e-abb2-4aa9cfe19b77): created successfully Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d097ce-2231-43b6-8e8b-48bddbcbe588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (0f4714ca-6844-4504-9a6e-3d8733a1284b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-2aae55df-18f9-4119-bf78-6edefd2321d7 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created volume successfully. Sep 15 19:06:37 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 Sep 15 19:06:37 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:38 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427" returned: 0 in 0.398s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91631118-8c0a-470d-9651-254a1cb2bee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8781ebb8-112f-498a-8e13-34f3735a6446]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:38 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852 1073741824" returned: 0 in 0.456s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:38 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852 Sep 15 19:06:38 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:38 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 Sep 15 19:06:38 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:38 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852" returned: 0 in 0.253s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.137s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-748464629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9d375f-3249-45ad-bda1-8f54cba5dfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00d86ad5b1c422f9cfe272e30ee2cad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:32Z,use_quota=True,user_id='ad838260b2a741608296999e508da0f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Creating volume be9d375f-3249-45ad-bda1-8f54cba5dfc3 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:38 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:38 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19802684-1f4c-40d0-bc2a-45bec7039d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-370d8197-2e38-46df-8d79-11e945cba852', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6464e565-1d5e-4d36-bd03-8eee83ffd513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:38 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 1073741824 Sep 15 19:06:38 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9" returned: 0 in 0.391s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:38 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume volume-370d8197-2e38-46df-8d79-11e945cba852 (370d8197-2e38-46df-8d79-11e945cba852): created successfully Sep 15 19:06:38 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 Sep 15 19:06:38 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6464e565-1d5e-4d36-bd03-8eee83ffd513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (705397b2-cc7d-4fa9-96f5-02718401670e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e68726f8-7d12-447e-8001-3338539e9b7a tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created volume successfully. Sep 15 19:06:38 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427" returned: 0 in 0.383s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:38 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427 Sep 15 19:06:38 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:38 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 1073741824" returned: 0 in 0.500s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:39 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 Sep 15 19:06:39 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:39 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9.7ed59f24-0143-453b-87b8-c1f063675427" returned: 0 in 0.255s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-7ed59f24-0143-453b-87b8-c1f063675427" released by "_delete_snapshot" :: held 1.548s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-91631118-8c0a-470d-9651-254a1cb2bee9" released by "delete_snapshot" :: held 1.575s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Created reservations ['4193ff99-93ec-4596-9667-654d7923df16', '755b0711-540d-42ba-8a99-bb736e56ca1f', '99db8efd-09f5-432c-8f1b-c37a638acb50', 'a9978ae5-613d-4d56-a0b0-e291ab6f9276'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:39 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3" returned: 0 in 0.286s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.550s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67593549-c841-4282-ab0d-b1039feb6bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f3d678683d7482fa2f53418e53cf2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:33Z,use_quota=True,user_id='3a3dea60a2884e34b4fcd863bef2bf74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6b29ae3-4f93-48fc-8057-ac12cb353f38),volume_type_id=e6b29ae3-4f93-48fc-8057-ac12cb353f38)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Creating volume 67593549-c841-4282-ab0d-b1039feb6bad {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:39 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995140ee-e6d8-4e41-ad1e-4615e99efa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb757c80-711e-4ce3-be5e-e05d3052a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:39 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad 1073741824 Sep 15 19:06:39 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:39 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Volume volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 (be9d375f-3249-45ad-bda1-8f54cba5dfc3): created successfully Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb757c80-711e-4ce3-be5e-e05d3052a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Flow 'volume_create_manager' (b4b9137c-d488-4171-8794-a36d41193e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:39 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Delete snapshot completed successfully. Sep 15 19:06:39 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-809880e9-9bd0-44dc-b6b1-0ec88562ef16 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created volume successfully. Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1823e717-3a31-4c94-a39e-aa176f86b08e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-7ed59f24-0143-453b-87b8-c1f063675427-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:39 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad 1073741824" returned: 0 in 0.431s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-91631118-8c0a-470d-9651-254a1cb2bee9-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Lock "cinder-91631118-8c0a-470d-9651-254a1cb2bee9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-91631118-8c0a-470d-9651-254a1cb2bee9" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:39 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad Sep 15 19:06:39 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-91631118-8c0a-470d-9651-254a1cb2bee9" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61d1d8d-095a-4df0-b827-32251473a6d2]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-be9d375f-3249-45ad-bda1-8f54cba5dfc3-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-be9d375f-3249-45ad-bda1-8f54cba5dfc3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-quobyte-be9d375f-3249-45ad-bda1-8f54cba5dfc3" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:40 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 Sep 15 19:06:40 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-be9d375f-3249-45ad-bda1-8f54cba5dfc3" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:40 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f44957-147d-45e7-893e-56a300883777]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad" returned: 0 in 0.320s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.826s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1321465888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db0fdef-b7aa-436b-8559-42de9a165ba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:35Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Creating volume 0db0fdef-b7aa-436b-8559-42de9a165ba5 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:40 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:40 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 1073741824 Sep 15 19:06:40 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Attempting download of b6b74479-374f-4fab-ba7e-0d1dca1fa1a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'metadata': {}}])) to volume 67593549-c841-4282-ab0d-b1039feb6bad. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e57435-be6f-46f7-a5c3-9d24bd830ca6]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_5r1eolwj {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:40 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 Sep 15 19:06:40 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:40 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9" returned: 0 in 0.433s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:40 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_5r1eolwj Sep 15 19:06:40 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:40 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9 Sep 15 19:06:40 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:40 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3" returned: 0 in 0.421s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:40 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3 Sep 15 19:06:40 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:40 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_5r1eolwj" returned: 0 in 0.361s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_5r1eolwj {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:40 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-91631118-8c0a-470d-9651-254a1cb2bee9" returned: 0 in 0.294s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:40 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 1073741824" returned: 0 in 0.515s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-91631118-8c0a-470d-9651-254a1cb2bee9" released by "delete_volume" :: held 0.807s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:40 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_5r1eolwj Sep 15 19:06:40 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:40 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 Sep 15 19:06:40 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Created reservations ['1b6c68ec-8c68-477d-98dc-27a9e81f9271', 'f9c7cf61-d67b-43ae-82bf-7c49d1a4532d', 'b50690be-b691-4bce-8a85-6bffba27c6cf', '756bc830-6f50-47e6-9970-7bef9e9a3ff6'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:40 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-be9d375f-3249-45ad-bda1-8f54cba5dfc3" returned: 0 in 0.348s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-be9d375f-3249-45ad-bda1-8f54cba5dfc3" released by "delete_volume" :: held 0.855s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:41 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_5r1eolwj" returned: 1 in 0.423s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_5r1eolwj' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cc3f64-445c-46ab-8f58-5f851100ccc4]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:41 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:41 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created reservations ['7b0986cf-2906-4799-b7c8-88eb338a5b90', '9a3ec5b6-e4b4-484a-97cf-bfddc19368e9', 'b0d9e7b5-3845-4dfd-85b5-9dd1cdf179db', '4f9386e3-35c2-4c1a-9f14-6850e1d34b29'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:41 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5" returned: 0 in 0.432s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.519s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-786567004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90b1bc5-4fd1-4144-a3a9-bd8218517f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:35Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Creating volume a90b1bc5-4fd1-4144-a3a9-bd8218517f1b {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:41 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:41 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD Sep 15 19:06:41 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:41 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b 1073741824 Sep 15 19:06:41 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a6cb8a6-a03e-4721-970c-3415907cfb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db0fdef-b7aa-436b-8559-42de9a165ba5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd1a02a-7cbd-4638-9c39-7575b4d2549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:41 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 (0db0fdef-b7aa-436b-8559-42de9a165ba5): created successfully Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd1a02a-7cbd-4638-9c39-7575b4d2549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (31de96f1-4cb9-44c6-be32-08b6e3701d3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:41 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-68966911-9a53-489a-b03a-7b8c731d19cd tempest-CreateVolumesFromSnapshotTest-971445185 None] Created volume successfully. Sep 15 19:06:41 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:41 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:41 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.545s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:41 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:41 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Deleted volume successfully. Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-48a0e3f3-849b-4205-9fd5-7268ca8523ea tempest-ProjectReaderTests-1438187467 None] Lock "cinder-91631118-8c0a-470d-9651-254a1cb2bee9-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:41 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.359s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (ff156746-b769-416b-961b-066ced4d1159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db449d94-e1cf-4155-ae82-039ec1675096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:41 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Deleted volume successfully. Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db449d94-e1cf-4155-ae82-039ec1675096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633204473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:42Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99665833-0978-4e88-bd7f-20664ec1c6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:41 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD Sep 15 19:06:41 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99665833-0978-4e88-bd7f-20664ec1c6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09aee79-b86b-477e-8888-d3fe8c68ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09aee79-b86b-477e-8888-d3fe8c68ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712', 'volume_name': 'volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbee30a-7823-45ec-9076-cd00f0ef4e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbee30a-7823-45ec-9076-cd00f0ef4e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0145e467-505a-4ab8-987c-de087ac56755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:41 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Volume 6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712', 'volume_size': 1} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-5cdeac5d-0756-4c32-a906-44649ebd0484 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-be9d375f-3249-45ad-bda1-8f54cba5dfc3-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:41 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b 1073741824" returned: 0 in 0.716s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:41 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b Sep 15 19:06:41 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:42 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD" returned: 1 in 0.486s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] b6b74479-374f-4fab-ba7e-0d1dca1fa1a3 was raw, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:42 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad Sep 15 19:06:42 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:42 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b" returned: 0 in 0.281s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.221s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1653285637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6375278-1efe-4e54-b7d8-c28dde3da67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:36Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Creating volume f6375278-1efe-4e54-b7d8-c28dde3da67d {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:42 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-370d8197-2e38-46df-8d79-11e945cba852-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:42 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d 1073741824 Sep 15 19:06:42 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1482273e-2c48-4c07-98eb-14689b1b1e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda49260-33c5-41b6-bb6d-c0988e14ed4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-370d8197-2e38-46df-8d79-11e945cba852-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:42 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b (a90b1bc5-4fd1-4144-a3a9-bd8218517f1b): created successfully Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda49260-33c5-41b6-bb6d-c0988e14ed4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (c010ae25-3201-4b29-b5d5-d17445ccae3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:42 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-742387f0-312b-4c4a-9062-513a1f4aaeb6 tempest-CreateVolumesFromSnapshotTest-971445185 None] Created volume successfully. Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-quobyte-370d8197-2e38-46df-8d79-11e945cba852" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-370d8197-2e38-46df-8d79-11e945cba852" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e97c50b-a280-4591-85b4-9ddbd03e315b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:42 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852 Sep 15 19:06:42 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:42 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad" returned: 0 in 0.562s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b6b74479-374f-4fab-ba7e-0d1dca1fa1a3_90ypyxw8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 19:06:42 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Converted 0.00 MB image at 0.00 MB/s Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:42 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad 1G Sep 15 19:06:42 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:42 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d 1073741824" returned: 0 in 0.524s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:42 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d Sep 15 19:06:42 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:42 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852" returned: 0 in 0.420s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:42 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852 Sep 15 19:06:42 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:42 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad 1G" returned: 0 in 0.357s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Downloaded image b6b74479-374f-4fab-ba7e-0d1dca1fa1a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'metadata': {}}])) to volume 67593549-c841-4282-ab0d-b1039feb6bad successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Temporary image b6b74479-374f-4fab-ba7e-0d1dca1fa1a3 for user 3a3dea60a2884e34b4fcd863bef2bf74 is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Marking volume 67593549-c841-4282-ab0d-b1039feb6bad as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Copying metadata from image b6b74479-374f-4fab-ba7e-0d1dca1fa1a3 to 67593549-c841-4282-ab0d-b1039feb6bad. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 19:06:42 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Creating volume glance metadata for volume 67593549-c841-4282-ab0d-b1039feb6bad backed by image b6b74479-374f-4fab-ba7e-0d1dca1fa1a3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'edbd87011c6d269738d9ec60da7ac039', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15ee6f9-e8ec-434b-a1f5-55e710374a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67593549-c841-4282-ab0d-b1039feb6bad', 'volume_size': 1, 'image_id': 'b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'edbd87011c6d269738d9ec60da7ac039', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7f3d678683d7482fa2f53418e53cf2c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0ca2a8f2a77a38bb94c1fe5817e8c79de5dffa24dcc6f8e9ae9eeba08e3efc9a19d13a1c8a40c4eaeef5e78dd37077a2a8969571d01dc6ea44c4fda291357b8e', 'id': 'b6b74479-374f-4fab-ba7e-0d1dca1fa1a3', 'created_at': datetime.datetime(2026, 9, 15, 17, 6, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 17, 6, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6b74479-374f-4fab-ba7e-0d1dca1fa1a3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4e8185-8964-4596-aba3-f93b897ce7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:43 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d" returned: 0 in 0.275s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.731s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-336020755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2930ecc-e5dc-4220-9204-e30cdd12b6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:36Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Creating volume f2930ecc-e5dc-4220-9204-e30cdd12b6c7 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:43 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:43 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Volume volume-67593549-c841-4282-ab0d-b1039feb6bad (67593549-c841-4282-ab0d-b1039feb6bad): created successfully Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a4e8185-8964-4596-aba3-f93b897ce7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Flow 'volume_create_manager' (7581d2ca-598d-4b26-8ad6-688b960e9849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:43 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 1073741824 Sep 15 19:06:43 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef3fbf2-c192-4c3e-892c-47a22f5d2641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6375278-1efe-4e54-b7d8-c28dde3da67d', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9e9a95-2883-44ec-a017-c94cc22fa0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:43 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a0fd9122-465e-4398-9e93-5a9dab96b8d2 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Created volume successfully. Sep 15 19:06:43 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume volume-f6375278-1efe-4e54-b7d8-c28dde3da67d (f6375278-1efe-4e54-b7d8-c28dde3da67d): created successfully Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9e9a95-2883-44ec-a017-c94cc22fa0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (fd832e2d-f828-4c49-93c6-cffa3152ee16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:43 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-be96d985-9c2e-49e0-b8b0-6d4385c088c4 tempest-CreateVolumesFromSnapshotTest-971445185 None] Created volume successfully. Sep 15 19:06:43 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-370d8197-2e38-46df-8d79-11e945cba852" returned: 0 in 0.353s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-370d8197-2e38-46df-8d79-11e945cba852" released by "delete_volume" :: held 0.818s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created reservations ['5bba8133-0aa6-4894-9f87-d7c947a07d2c', '83fc3795-4bf4-498f-8bad-f4f787693340', '29a19117-e030-4069-bb43-496f1226a78a', 'ce5fe4ba-bc2f-4e4f-b50a-6f2e48ef2ba5'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:43 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:43 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-2116c385-5670-4d3e-abb2-4aa9cfe19b77-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-2116c385-5670-4d3e-abb2-4aa9cfe19b77-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Acquiring lock "cinder-67593549-c841-4282-ab0d-b1039feb6bad-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-quobyte-2116c385-5670-4d3e-abb2-4aa9cfe19b77" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-2116c385-5670-4d3e-abb2-4aa9cfe19b77" acquired by "delete_volume" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "cinder-67593549-c841-4282-ab0d-b1039feb6bad-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88decd6-b16f-4bbb-90e5-963d129a9ea8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Acquiring lock "cinder-quobyte-67593549-c841-4282-ab0d-b1039feb6bad" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "cinder-quobyte-67593549-c841-4282-ab0d-b1039feb6bad" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6883bc97-e4b6-4e4c-aa3a-297602d2dcaf]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:43 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.377s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:43 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 1073741824" returned: 0 in 0.624s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:43 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Deleted volume successfully. Sep 15 19:06:43 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 Sep 15 19:06:43 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bda0ccb8-86be-4688-86e4-27202a15c9b6 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-370d8197-2e38-46df-8d79-11e945cba852-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:43 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 Sep 15 19:06:43 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:43 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad Sep 15 19:06:43 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:44 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77" returned: 0 in 0.411s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:44 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7" returned: 0 in 0.257s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.288s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:44 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77 Sep 15 19:06:44 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1793320275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ec3d3f-8aef-4702-8b69-7fdb8511880f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4d626b765d45d5872364773f7b48f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:37Z,use_quota=True,user_id='b48b42603c6e4f79aa1e9d5f825ea90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Creating volume 81ec3d3f-8aef-4702-8b69-7fdb8511880f {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:44 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4545c38-9ee6-483e-8c81-2112722e28bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5524067-f873-43d5-899a-3ea9d6532523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:44 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f 1073741824 Sep 15 19:06:44 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:44 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 (f2930ecc-e5dc-4220-9204-e30cdd12b6c7): created successfully Sep 15 19:06:44 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5524067-f873-43d5-899a-3ea9d6532523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (08bff743-1c20-4db9-9cff-15e397ec2144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad" returned: 0 in 0.415s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:44 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3ac76348-1822-4fa8-ac3e-d53d4651fbca tempest-CreateVolumesFromSnapshotTest-971445185 None] Created volume successfully. Sep 15 19:06:44 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad Sep 15 19:06:44 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:44 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-2116c385-5670-4d3e-abb2-4aa9cfe19b77" returned: 0 in 0.321s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-2116c385-5670-4d3e-abb2-4aa9cfe19b77" released by "delete_volume" :: held 0.804s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created reservations ['116eeafe-035b-4b5b-ad71-35caac073182', '41bc1ae0-f928-4647-aeda-4ffcc987ab2c', '967d0b26-a668-4664-8378-f1db81229436', '59427f1c-45e8-427b-9ef0-0f111f17cdd2'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:44 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-67593549-c841-4282-ab0d-b1039feb6bad" returned: 0 in 0.317s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "cinder-quobyte-67593549-c841-4282-ab0d-b1039feb6bad" released by "delete_volume" :: held 0.795s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Created reservations ['07a6f60b-cf7d-4af6-8c1d-d252a1d3d627', 'e9da7375-1cc0-4721-819d-90ddb8fae02b', 'd18cbe19-1366-4ed3-8c50-70ccef6f7dce', '1a2227c0-2e68-4958-a2a8-6364a99f1a8f'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:44 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:44 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:44 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f 1073741824" returned: 0 in 0.537s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-da48a090-a476-41d2-8c72-582a0735db8b-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:44 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:44 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-da48a090-a476-41d2-8c72-582a0735db8b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:44 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f Sep 15 19:06:44 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-quobyte-da48a090-a476-41d2-8c72-582a0735db8b" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-da48a090-a476-41d2-8c72-582a0735db8b" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a354e2-2c81-43be-a579-a122b9ee6e1f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:45 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.480s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:45 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Deleted volume successfully. Sep 15 19:06:45 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f" returned: 0 in 0.350s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.227s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-633204473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:42Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Creating volume 6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:45 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:45 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b Sep 15 19:06:45 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:45 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 1073741824 Sep 15 19:06:45 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01543f32-4344-4c82-b637-5d002c8cfba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15e6f79-254c-43fd-92d1-1309b846b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-aee17f3f-96b8-4ee8-9946-a5c8ee645e19 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-2116c385-5670-4d3e-abb2-4aa9cfe19b77-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:45 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Volume volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f (81ec3d3f-8aef-4702-8b69-7fdb8511880f): created successfully Sep 15 19:06:45 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f15e6f79-254c-43fd-92d1-1309b846b956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Flow 'volume_create_manager' (28766e09-7996-4406-9fda-bec5154d2a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.518s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:45 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Deleted volume successfully. Sep 15 19:06:45 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-5d53e9b2-e99d-4399-aa4c-567d45b339d1 tempest-CreateVolumesFromSnapshotTest-971445185 None] Created volume successfully. Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-435e605f-1182-4c62-a782-b903901b9ed0 tempest-VolumeAndVolumeTypeFromImageTest-1572733394 None] Lock "cinder-67593549-c841-4282-ab0d-b1039feb6bad-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:45 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b" returned: 0 in 0.483s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:45 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b Sep 15 19:06:45 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-81ec3d3f-8aef-4702-8b69-7fdb8511880f-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-81ec3d3f-8aef-4702-8b69-7fdb8511880f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-quobyte-81ec3d3f-8aef-4702-8b69-7fdb8511880f" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-81ec3d3f-8aef-4702-8b69-7fdb8511880f" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:45 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 1073741824" returned: 0 in 0.635s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf00930-b09c-4d13-a02f-df751b5fdf8d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:45 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-da48a090-a476-41d2-8c72-582a0735db8b" returned: 0 in 0.335s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-da48a090-a476-41d2-8c72-582a0735db8b" released by "delete_volume" :: held 0.899s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:45 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f Sep 15 19:06:45 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:45 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 Sep 15 19:06:45 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:45 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:45 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:45 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created reservations ['94fee4a2-d689-42ca-b269-548ece01fff4', 'a0bdd062-c19d-4e58-bcfc-cb4b4b57e27e', '5719f74f-72c8-415d-8112-f51c049a0d1d', '2c59a988-37b9-4cf9-b477-843d97b9f1b8'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:46 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:46 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:46 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.352s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 19:06:46 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" returned: 0 in 0.431s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0145e467-505a-4ab8-987c-de087ac56755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719602d2-6f57-4e92-b6f4-281e4c772ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:46 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Volume volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 (6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712): created successfully Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719602d2-6f57-4e92-b6f4-281e4c772ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (ff156746-b769-416b-961b-066ced4d1159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6589f927-2576-44cb-a030-dc9b725f83b2 tempest-ProjectReaderTests-1438187467 None] Created volume successfully. Sep 15 19:06:46 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f" returned: 0 in 0.580s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:46 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f Sep 15 19:06:46 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:46 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.323s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Deleted volume successfully. Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-67d1eb2f-cf1e-4c05-876e-a6e9597fc4df tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-da48a090-a476-41d2-8c72-582a0735db8b-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:46 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-81ec3d3f-8aef-4702-8b69-7fdb8511880f" returned: 0 in 0.280s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-81ec3d3f-8aef-4702-8b69-7fdb8511880f" released by "delete_volume" :: held 0.924s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Created reservations ['d7b2518a-e96a-4b16-9a63-76ed6e3c4cef', 'a170727c-2eec-416a-9a8f-60ae8d10b3cc', '1da337e6-4ff9-4679-af48-48b860b4534e', 'd0224981-37a4-4fd4-b836-a8937ccbc51f'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:46 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:46 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-f2930ecc-e5dc-4220-9204-e30cdd12b6c7-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-f2930ecc-e5dc-4220-9204-e30cdd12b6c7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-quobyte-f2930ecc-e5dc-4220-9204-e30cdd12b6c7" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-f2930ecc-e5dc-4220-9204-e30cdd12b6c7" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[3448e8e1-fa90-45c7-84f3-f188782e4b5a]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-74c7b05e-c6fb-4147-8e92-e2a30eb73256-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:47 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 Sep 15 19:06:47 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-74c7b05e-c6fb-4147-8e92-e2a30eb73256-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:47 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.409s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:47 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Deleted volume successfully. Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-quobyte-74c7b05e-c6fb-4147-8e92-e2a30eb73256" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a97c33ed-acad-4739-a9c6-7f485307294a tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-81ec3d3f-8aef-4702-8b69-7fdb8511880f-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-74c7b05e-c6fb-4147-8e92-e2a30eb73256" acquired by "delete_volume" :: waited 0.035s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2978d058-662a-456a-bcc9-9e244e6c48b9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:47 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 Sep 15 19:06:47 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:47 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7" returned: 0 in 0.567s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:47 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7 Sep 15 19:06:47 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Creating offline snapshot 67117b6b-4348-4127-8317-fec14a71313a of volume 6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b446b43b-ecae-4f5a-b73c-20cdde2779b6]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:47 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f2930ecc-e5dc-4220-9204-e30cdd12b6c7" returned: 0 in 0.336s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:47 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256" returned: 0 in 0.549s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-f2930ecc-e5dc-4220-9204-e30cdd12b6c7" released by "delete_volume" :: held 0.981s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:47 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 Sep 15 19:06:47 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:47 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256 Sep 15 19:06:47 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Created reservations ['b9916d18-26e5-4658-9b1d-06735b342dc7', '74b18455-3aec-443c-8555-d29601aac60b', '0c9df358-8cf3-4cf7-8616-a0f9a2252229', '9eecbc24-bb06-4264-b3a8-bf70767900f8'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:48 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:48 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:48 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:48 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" returned: 0 in 0.457s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74c7b05e-c6fb-4147-8e92-e2a30eb73256" returned: 0 in 0.341s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:48 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a 1G Sep 15 19:06:48 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-74c7b05e-c6fb-4147-8e92-e2a30eb73256" released by "delete_volume" :: held 0.979s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created reservations ['ff66a35c-7ce5-47c5-97b3-ad37029dab10', '933a1191-2bdf-4acb-b696-37570ab2aab9', 'ec107369-ef9f-49a9-9b12-f1b17353ad15', '05853a5a-adff-4c51-88f4-7ff47c9e9ea1'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:48 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.359s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-f6375278-1efe-4e54-b7d8-c28dde3da67d-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:48 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Deleted volume successfully. Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-f6375278-1efe-4e54-b7d8-c28dde3da67d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6f11104c-81ba-4eea-a6ce-b968c8e1cffc tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-f2930ecc-e5dc-4220-9204-e30cdd12b6c7-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:48 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:48 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-quobyte-f6375278-1efe-4e54-b7d8-c28dde3da67d" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-f6375278-1efe-4e54-b7d8-c28dde3da67d" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a5fded-2d90-4e83-bac2-107df05cad01]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:48 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d Sep 15 19:06:48 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:48 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a 1G" returned: 0 in 0.591s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:48 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.322s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:48 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Deleted volume successfully. Sep 15 19:06:48 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a Sep 15 19:06:48 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7093bdb2-8805-4d69-b58d-8c19956cab9c tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-74c7b05e-c6fb-4147-8e92-e2a30eb73256-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:48 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d" returned: 0 in 0.421s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:49 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d Sep 15 19:06:49 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a" returned: 0 in 0.364s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:49 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a is being set with open permissions: ugo+rw Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:49 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:49 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a Sep 15 19:06:49 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:49 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f6375278-1efe-4e54-b7d8-c28dde3da67d" returned: 0 in 0.304s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-f6375278-1efe-4e54-b7d8-c28dde3da67d" released by "delete_volume" :: held 0.787s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Created reservations ['4a61ff5f-e3b6-407f-adc7-8e3b29a6ba6f', '4f14ae84-52ef-4fa3-93c5-4c4276ac97ba', 'c5a3bc6b-f4d1-4216-aba7-8df64bfedba0', 'e78f1ede-92fd-4784-b2d5-d82ccd4c3a73'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:49 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a" returned: 0 in 0.324s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:49 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:49 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-11ff8d2e-9a89-4350-a041-9205a8d95799-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-11ff8d2e-9a89-4350-a041-9205a8d95799-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:49 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.info Sep 15 19:06:49 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "cinder-quobyte-11ff8d2e-9a89-4350-a041-9205a8d95799" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-11ff8d2e-9a89-4350-a041-9205a8d95799" acquired by "delete_volume" :: waited 0.045s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[737a6d4d-297c-46bf-a1a0-94df0b18c6bb]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-quobyte-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:49 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.448s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:49 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Deleted volume successfully. Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8353e8a0-b66a-4407-b30f-659e1247f5a4]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:49 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799 Sep 15 19:06:49 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:49 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7b830922-3df2-4f94-bee6-ad4e8fefc613 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-f6375278-1efe-4e54-b7d8-c28dde3da67d-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:50 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.info" returned: 0 in 0.565s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:50 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.info is being set with open permissions: ugo+rw Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:50 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b Sep 15 19:06:50 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:50 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.info Sep 15 19:06:50 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:50 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799" returned: 0 in 0.483s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:50 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799 Sep 15 19:06:50 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:50 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.info" returned: 0 in 0.290s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:50 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b" returned: 0 in 0.458s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:50 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b Sep 15 19:06:50 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c37fd407-9ace-4c3a-ac97-1216d0f36f6e tempest-ProjectReaderTests-1438187467 None] Create snapshot completed successfully Sep 15 19:06:50 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:50 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-11ff8d2e-9a89-4350-a041-9205a8d95799" returned: 0 in 0.323s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-quobyte-11ff8d2e-9a89-4350-a041-9205a8d95799" released by "delete_volume" :: held 0.905s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:50 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Created reservations ['8766aaea-99aa-462b-b866-38372c597c4c', '5757b014-ae90-46c3-94c3-65775b8ae3ab', '66286d2f-2a2d-45e7-bbe8-6b9073f5f584', '65aa1b32-610c-4cf3-9f31-327430c0643d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b" returned: 0 in 0.332s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b" released by "delete_volume" :: held 0.871s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (80eed676-045f-49f9-9e70-c6de7dac58f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3e85e3-b354-4af0-a346-d54035df9eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3e85e3-b354-4af0-a346-d54035df9eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114259587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0573979-98a7-4518-8472-c492cfb30649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:51Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ced5fb5-28b4-4029-ac24-26e0ee6c8bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ced5fb5-28b4-4029-ac24-26e0ee6c8bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2260e2b9-8f06-4cf7-bc50-da0a06b4e763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2260e2b9-8f06-4cf7-bc50-da0a06b4e763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0573979-98a7-4518-8472-c492cfb30649', 'volume_name': 'volume-d0573979-98a7-4518-8472-c492cfb30649', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc20981e-d028-4c5f-889b-8d1d1a34455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc20981e-d028-4c5f-889b-8d1d1a34455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab3b64b-1419-4edb-8fc2-54a7384a4f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:50 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Volume d0573979-98a7-4518-8472-c492cfb30649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0573979-98a7-4518-8472-c492cfb30649', 'volume_size': 1} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1114259587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0573979-98a7-4518-8472-c492cfb30649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:51Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Creating volume d0573979-98a7-4518-8472-c492cfb30649 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:50 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:50 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649 1073741824 Sep 15 19:06:50 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-67117b6b-4348-4127-8317-fec14a71313a-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-67117b6b-4348-4127-8317-fec14a71313a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-67117b6b-4348-4127-8317-fec14a71313a" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-67117b6b-4348-4127-8317-fec14a71313a" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Deleting offline snapshot 67117b6b-4348-4127-8317-fec14a71313a of volume 6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:06:51 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:51 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] snapshot_file for this snap is: volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Created reservations ['242109c2-2732-406d-942b-8388a5526001', '08376488-f4c8-45f4-8233-81a6a4688c58', 'acfea821-c1c7-428a-9d42-49fa4cf08a9c', 'c640622f-564d-4a73-87e7-521a8ba29beb'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5332450-3360-494e-a247-940fdbeea838]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (266fff70-a7a7-47c4-b8be-34775996ae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d13a75-b31d-4d33-a133-1f6a581201a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d13a75-b31d-4d33-a133-1f6a581201a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208153424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860f6d06-730a-462c-9335-9eff9f7a1fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:51Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:51 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a Sep 15 19:06:51 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c468ca-cc77-49d6-9247-2fb468298736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4c468ca-cc77-49d6-9247-2fb468298736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab54b8e3-e103-42ba-bfa6-f0298061a81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab54b8e3-e103-42ba-bfa6-f0298061a81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860f6d06-730a-462c-9335-9eff9f7a1fab', 'volume_name': 'volume-860f6d06-730a-462c-9335-9eff9f7a1fab', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c2b964-7140-49df-9b7a-c2673e3c4a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c2b964-7140-49df-9b7a-c2673e3c4a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eddc6a-2e38-4a78-9f3e-d5f0060631c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Volume 860f6d06-730a-462c-9335-9eff9f7a1fab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860f6d06-730a-462c-9335-9eff9f7a1fab', 'volume_size': 1} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:51 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.392s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:51 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:51 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Deleted volume successfully. Sep 15 19:06:51 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649 1073741824" returned: 0 in 0.601s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b9a2d2c6-4ffc-44c2-9116-9250aef76060 tempest-CreateVolumesFromSourceVolumeTest-1593846165 None] Lock "cinder-11ff8d2e-9a89-4350-a041-9205a8d95799-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:51 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649 Sep 15 19:06:51 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (9c0ca022-59a0-4e17-a5b4-9810ec629209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995c96c2-e524-49a0-9720-1ca40d3b1f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995c96c2-e524-49a0-9720-1ca40d3b1f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532927807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218be919-c347-4e32-92ae-9316a46ce38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:52Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95619ef5-11c3-432a-a9a8-baf48efcb2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95619ef5-11c3-432a-a9a8-baf48efcb2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:51 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56109e47-9f2e-4d04-b243-fb13cba38069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56109e47-9f2e-4d04-b243-fb13cba38069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '218be919-c347-4e32-92ae-9316a46ce38c', 'volume_name': 'volume-218be919-c347-4e32-92ae-9316a46ce38c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1d491f-c73f-4ab3-a552-f4e870252ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1d491f-c73f-4ab3-a552-f4e870252ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:51 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4bd7d3-db32-4367-963d-e1d57dc7bd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Volume 218be919-c347-4e32-92ae-9316a46ce38c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-218be919-c347-4e32-92ae-9316a46ce38c', 'volume_size': 1} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.445s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649" returned: 0 in 0.344s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a" returned: 0 in 0.731s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208153424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860f6d06-730a-462c-9335-9eff9f7a1fab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:51Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Creating volume 860f6d06-730a-462c-9335-9eff9f7a1fab {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:51 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89560e6-2c5e-40d0-99fd-ccb5cc0f49e1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Deleted volume successfully. Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:52 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab 1073741824 Sep 15 19:06:52 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab3b64b-1419-4edb-8fc2-54a7384a4f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0573979-98a7-4518-8472-c492cfb30649', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b7b312-99a7-4010-a2a0-1fea4748c319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:52 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Volume volume-d0573979-98a7-4518-8472-c492cfb30649 (d0573979-98a7-4518-8472-c492cfb30649): created successfully Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b7b312-99a7-4010-a2a0-1fea4748c319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (80eed676-045f-49f9-9e70-c6de7dac58f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-636d5ab8-49fa-43cb-b30b-e7951e642b6f tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-a90b1bc5-4fd1-4144-a3a9-bd8218517f1b-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-0db0fdef-b7aa-436b-8559-42de9a165ba5-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-13ef6f14-aa13-4c39-84bd-0a38e514d01e tempest-CreateVolumesFromImageTest-156932781 None] Created volume successfully. Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-0db0fdef-b7aa-436b-8559-42de9a165ba5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:52 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 Sep 15 19:06:52 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-quobyte-0db0fdef-b7aa-436b-8559-42de9a165ba5" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-0db0fdef-b7aa-436b-8559-42de9a165ba5" acquired by "delete_volume" :: waited 0.033s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fb3b96-c343-4883-b92d-2c719dcb5c2c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:52 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 Sep 15 19:06:52 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:52 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (8fa67779-6f17-45b2-8d07-b5c251beba3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee5fb4c-1d11-4ec5-8193-ce30951b0b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" returned: 0 in 0.582s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eee5fb4c-1d11-4ec5-8193-ce30951b0b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-57089730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14676c2-06e8-4750-af0a-de85197ab4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:52Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:52 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a Sep 15 19:06:52 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cf42a2-9c50-441e-86b4-8eb2f7df66e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95cf42a2-9c50-441e-86b4-8eb2f7df66e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49960622-8770-4b7b-9bf4-5af0df66a09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49960622-8770-4b7b-9bf4-5af0df66a09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e14676c2-06e8-4750-af0a-de85197ab4f4', 'volume_name': 'volume-e14676c2-06e8-4750-af0a-de85197ab4f4', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2202eb90-ba0d-40f2-8c4b-3a79b902b4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2202eb90-ba0d-40f2-8c4b-3a79b902b4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86e04fc-07c0-43d5-8045-16ee13a83cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:52 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Volume e14676c2-06e8-4750-af0a-de85197ab4f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e14676c2-06e8-4750-af0a-de85197ab4f4', 'volume_size': 1} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:52 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab 1073741824" returned: 0 in 0.829s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:52 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab Sep 15 19:06:52 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:52 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5" returned: 0 in 0.596s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:53 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5 Sep 15 19:06:53 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (31f2bdda-2f35-4144-955b-187251311192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:53 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79694db8-6e60-4c5d-ada9-63bc8812ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a" returned: 0 in 0.595s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:53 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79694db8-6e60-4c5d-ada9-63bc8812ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1197371803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5696dcf-d184-4914-8693-772418502553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:53Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364d5c99-7828-421e-9ab6-50900a7801b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:53 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a Sep 15 19:06:53 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364d5c99-7828-421e-9ab6-50900a7801b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d30539-60b2-49d8-8b30-432b5b1941c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d30539-60b2-49d8-8b30-432b5b1941c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5696dcf-d184-4914-8693-772418502553', 'volume_name': 'volume-f5696dcf-d184-4914-8693-772418502553', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12581421-bfd0-4874-bd15-5ce7f0612d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12581421-bfd0-4874-bd15-5ce7f0612d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0205bf5a-07ff-48cb-a911-0fd1fb1ee2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:53 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Volume f5696dcf-d184-4914-8693-772418502553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5696dcf-d184-4914-8693-772418502553', 'volume_size': 1} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab" returned: 0 in 0.406s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.348s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532927807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=218be919-c347-4e32-92ae-9316a46ce38c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:52Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Creating volume 218be919-c347-4e32-92ae-9316a46ce38c {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:53 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:53 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c 1073741824 Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44eddc6a-2e38-4a78-9f3e-d5f0060631c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860f6d06-730a-462c-9335-9eff9f7a1fab', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:53 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c9be83-dae9-4a3f-8845-63a8c5f0c45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:53 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Volume volume-860f6d06-730a-462c-9335-9eff9f7a1fab (860f6d06-730a-462c-9335-9eff9f7a1fab): created successfully Sep 15 19:06:53 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c9be83-dae9-4a3f-8845-63a8c5f0c45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (266fff70-a7a7-47c4-b8be-34775996ae58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-0db0fdef-b7aa-436b-8559-42de9a165ba5" returned: 0 in 0.419s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-0db0fdef-b7aa-436b-8559-42de9a165ba5" released by "delete_volume" :: held 1.111s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:53 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d9c28f93-7e55-4f0e-88c1-77b4b9b4ad1a tempest-CreateVolumesFromImageTest-156932781 None] Created volume successfully. Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Created reservations ['e1ddf3db-377b-4af2-a19a-36151788be92', '0f0fc707-c168-4cd3-bda7-0453ee979520', 'a1d9a3a7-2c55-4fef-8e79-4c3bdb5495ef', '66cc1878-6f89-4f95-b1d4-19fd5ea0d353'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:53 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712.67117b6b-4348-4127-8317-fec14a71313a" returned: 0 in 0.321s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-67117b6b-4348-4127-8317-fec14a71313a" released by "_delete_snapshot" :: held 2.417s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" released by "delete_snapshot" :: held 2.524s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:53 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:53 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Created reservations ['6f40bb3c-bc4c-410f-b752-922a4d6d7a1a', '8a5d7477-58e5-4d69-a4e0-3851c85862e9', 'd3c74d8d-b427-4bc5-9447-22d711a05030', '99c8e3aa-8439-45c4-9874-3acd228f3a23'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:53 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Delete snapshot completed successfully. Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-52fe6ca9-6dca-4d04-9f09-d86faf8e5548 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-67117b6b-4348-4127-8317-fec14a71313a-delete_snapshot" released by "delete_snapshot" :: held 2.749s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:53 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c 1073741824" returned: 0 in 0.639s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:53 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.377s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:53 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Deleted volume successfully. Sep 15 19:06:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-29a50c63-9dcf-49e4-ae9b-b1ef8c1495ab tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-0db0fdef-b7aa-436b-8559-42de9a165ba5-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:54 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c Sep 15 19:06:54 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:54 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c" returned: 0 in 0.297s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-57089730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e14676c2-06e8-4750-af0a-de85197ab4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:52Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Creating volume e14676c2-06e8-4750-af0a-de85197ab4f4 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:54 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:54 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4 1073741824 Sep 15 19:06:54 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4bd7d3-db32-4367-963d-e1d57dc7bd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-218be919-c347-4e32-92ae-9316a46ce38c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5616498a-c883-4c84-b5f8-5957c9ec51e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:54 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Volume volume-218be919-c347-4e32-92ae-9316a46ce38c (218be919-c347-4e32-92ae-9316a46ce38c): created successfully Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5616498a-c883-4c84-b5f8-5957c9ec51e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (9c0ca022-59a0-4e17-a5b4-9810ec629209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-19cf2c10-80c7-4f2f-991c-753b88d27cb1 tempest-CreateVolumesFromImageTest-156932781 None] Created volume successfully. Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-342d2c20-4195-4790-aa51-aa29e7b764ee-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-342d2c20-4195-4790-aa51-aa29e7b764ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-quobyte-3348839b-3c52-4fda-8bff-129dee12ac8b" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b617418a-8d1a-4daa-9e90-3bd1874579b1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-3348839b-3c52-4fda-8bff-129dee12ac8b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-quobyte-342d2c20-4195-4790-aa51-aa29e7b764ee" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-342d2c20-4195-4790-aa51-aa29e7b764ee" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Deleting offline snapshot 342d2c20-4195-4790-aa51-aa29e7b764ee of volume 3348839b-3c52-4fda-8bff-129dee12ac8b {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] snapshot_file for this snap is: volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[393b4eb1-997e-4d8e-b713-01e7dc1f7a46]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:54 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 Sep 15 19:06:54 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:54 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee Sep 15 19:06:54 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:54 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4 1073741824" returned: 0 in 0.600s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:54 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" returned: 0 in 0.464s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:55 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4 Sep 15 19:06:55 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:55 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712 Sep 15 19:06:55 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:55 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee" returned: 0 in 0.487s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3348839b-3c52-4fda-8bff-129dee12ac8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cb8c8d-d114-490b-b155-4119a1c3e204]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:55 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:55 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b Sep 15 19:06:55 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" returned: 0 in 0.324s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:55 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4" returned: 0 in 0.366s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712" released by "delete_volume" :: held 0.906s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.067s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1197371803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5696dcf-d184-4914-8693-772418502553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59857ecb16734c3290644b0bcaf15149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:53Z,use_quota=True,user_id='76e5b610e18145e9a46da63aee0c6b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Creating volume f5696dcf-d184-4914-8693-772418502553 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:55 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86e04fc-07c0-43d5-8045-16ee13a83cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e14676c2-06e8-4750-af0a-de85197ab4f4', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:55 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553 1073741824 Sep 15 19:06:55 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65217a8-fd08-40b0-8ee2-2475961bcf75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:55 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Volume volume-e14676c2-06e8-4750-af0a-de85197ab4f4 (e14676c2-06e8-4750-af0a-de85197ab4f4): created successfully Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65217a8-fd08-40b0-8ee2-2475961bcf75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (8fa67779-6f17-45b2-8d07-b5c251beba3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a822e783-3528-4ae0-9736-af52e14d087f tempest-CreateVolumesFromImageTest-156932781 None] Created volume successfully. Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Created reservations ['9547fa9c-6652-4932-ba10-b7a1cda47ac7', '78743610-dfc1-4196-ba21-44c1aa4b4c9c', '95ad5de2-0d59-4c5d-a2ba-7419afde60b4', 'd7fab680-703c-49a8-8206-252db45e38c3'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:55 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b" returned: 0 in 0.466s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:55 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:55 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:55 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee Sep 15 19:06:55 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:55 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.293s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:55 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Deleted volume successfully. Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553 1073741824" returned: 0 in 0.572s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d8409827-390c-4a72-a1ba-51b693ca50a4 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-6f8eaa1e-84ef-47f1-ba0a-0b1e479b4712-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:56 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553 Sep 15 19:06:56 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:56 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee" returned: 0 in 0.457s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:56 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee Sep 15 19:06:56 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:56 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553" returned: 0 in 0.264s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-019cc103-b2fd-4e3c-a068-831adbfd5fa0 tempest-ProjectAdminTests-1196307116 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9375953674316, 'free_capacity_gb': 1775.9375953674316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86137) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0205bf5a-07ff-48cb-a911-0fd1fb1ee2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5696dcf-d184-4914-8693-772418502553', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f69656e-d0b9-4271-979d-368453a1ecf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:56 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Volume volume-f5696dcf-d184-4914-8693-772418502553 (f5696dcf-d184-4914-8693-772418502553): created successfully Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f69656e-d0b9-4271-979d-368453a1ecf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Flow 'volume_create_manager' (31f2bdda-2f35-4144-955b-187251311192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:56 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7672c20a-e756-4c8c-a07e-ba9ec42f6376 tempest-CreateVolumesFromImageTest-156932781 None] Created volume successfully. Sep 15 19:06:56 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b.342d2c20-4195-4790-aa51-aa29e7b764ee" returned: 0 in 0.293s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-342d2c20-4195-4790-aa51-aa29e7b764ee" released by "_delete_snapshot" :: held 1.863s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-3348839b-3c52-4fda-8bff-129dee12ac8b" released by "delete_snapshot" :: held 1.900s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-f5696dcf-d184-4914-8693-772418502553-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-f5696dcf-d184-4914-8693-772418502553-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Created reservations ['955061bc-6799-463b-8548-def87a6230e8', 'cae751ae-906e-437a-9e89-43aa395938c4', '5689ab81-ec7b-4f6e-82fc-a17af51de992', '0a7051cc-2620-4f09-bbb1-41ab350886db'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-quobyte-f5696dcf-d184-4914-8693-772418502553" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-f5696dcf-d184-4914-8693-772418502553" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d9bc5-9eb2-4865-afe4-83169f721ece]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:56 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Delete snapshot completed successfully. Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-83450edf-4a8b-4fcf-9f67-4b8b027468da tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-342d2c20-4195-4790-aa51-aa29e7b764ee-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-3348839b-3c52-4fda-8bff-129dee12ac8b-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-3348839b-3c52-4fda-8bff-129dee12ac8b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "cinder-quobyte-3348839b-3c52-4fda-8bff-129dee12ac8b" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-3348839b-3c52-4fda-8bff-129dee12ac8b" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:56 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553 Sep 15 19:06:56 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0a13ee-e8af-46d5-acc5-cba297cc1ea0]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:57 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b Sep 15 19:06:57 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:57 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553" returned: 0 in 0.503s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:57 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553 Sep 15 19:06:57 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (f909f20d-aeec-4afc-ac33-d25c33b5840a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5603b737-af6f-410d-b797-0893a6667ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5603b737-af6f-410d-b797-0893a6667ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396535020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757a68b0-4778-4415-b73e-2d562c838e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:57Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d285f3c4-d8fa-4427-9725-11597a0a2893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d285f3c4-d8fa-4427-9725-11597a0a2893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce09321e-b239-4cd6-baea-ee19c9375554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce09321e-b239-4cd6-baea-ee19c9375554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '757a68b0-4778-4415-b73e-2d562c838e27', 'volume_name': 'volume-757a68b0-4778-4415-b73e-2d562c838e27', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278526dc-f2db-4c1b-8e91-737a1f585187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278526dc-f2db-4c1b-8e91-737a1f585187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e301a16-45a5-4487-bca4-d4e1e77559a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:57 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Volume 757a68b0-4778-4415-b73e-2d562c838e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-757a68b0-4778-4415-b73e-2d562c838e27', 'volume_size': 1} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1396535020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=757a68b0-4778-4415-b73e-2d562c838e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:06:57Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Creating volume 757a68b0-4778-4415-b73e-2d562c838e27 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:06:57 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:57 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 1073741824 Sep 15 19:06:57 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:57 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b" returned: 0 in 0.470s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:57 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b Sep 15 19:06:57 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:57 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-f5696dcf-d184-4914-8693-772418502553" returned: 0 in 0.301s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-f5696dcf-d184-4914-8693-772418502553" released by "delete_volume" :: held 0.873s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Created reservations ['63250fc1-cc60-4712-ba58-be78a77d909b', '3c33dda4-bd41-4440-972d-084985112357', 'f0c84b36-ca69-4ff7-b2b1-fe70eb013025', '1cf77f1d-79a2-40ef-a0b3-9acf6a91688d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:57 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:57 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:57 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3348839b-3c52-4fda-8bff-129dee12ac8b" returned: 0 in 0.385s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-e14676c2-06e8-4750-af0a-de85197ab4f4-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-quobyte-3348839b-3c52-4fda-8bff-129dee12ac8b" released by "delete_volume" :: held 0.969s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-e14676c2-06e8-4750-af0a-de85197ab4f4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-quobyte-e14676c2-06e8-4750-af0a-de85197ab4f4" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:06:57 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Created reservations ['33e13bfe-6cc2-4ad9-ae17-a73d6be025aa', 'e9fe421f-33b4-4957-985d-6c8d9e841eed', 'dcc71ca6-06c4-4f96-a502-dcb7f1400f47', '97bd6e2b-ec35-46cc-bcd6-086895db545f'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-e14676c2-06e8-4750-af0a-de85197ab4f4" acquired by "delete_volume" :: waited 0.043s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:06:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 1073741824" returned: 0 in 0.694s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d4afad-0b29-47e5-9622-5383112ce57d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:58 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:58 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 Sep 15 19:06:58 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.474s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:58 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Deleted volume successfully. Sep 15 19:06:58 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:58 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-871919ba-3b76-4669-8051-27b69adf270f tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-f5696dcf-d184-4914-8693-772418502553-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:58 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4 Sep 15 19:06:58 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:58 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27" returned: 0 in 0.355s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e301a16-45a5-4487-bca4-d4e1e77559a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-757a68b0-4778-4415-b73e-2d562c838e27', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb1376f-ffec-4bef-af95-69b1a6e99417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:06:58 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.325s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:58 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Volume volume-757a68b0-4778-4415-b73e-2d562c838e27 (757a68b0-4778-4415-b73e-2d562c838e27): created successfully Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb1376f-ffec-4bef-af95-69b1a6e99417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (f909f20d-aeec-4afc-ac33-d25c33b5840a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:06:58 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Deleted volume successfully. Sep 15 19:06:58 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-03fcc873-bcc4-420d-8d2c-2a7afbad43af tempest-ProjectReaderTests-1438187467 None] Created volume successfully. Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-30cfcad1-42e0-4d6b-a109-ca1a7e629626 tempest-CreateVolumesFromSnapshotTest-971445185 None] Lock "cinder-3348839b-3c52-4fda-8bff-129dee12ac8b-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:58 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4" returned: 0 in 0.517s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:58 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4 Sep 15 19:06:58 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:58 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-e14676c2-06e8-4750-af0a-de85197ab4f4" returned: 0 in 0.255s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-e14676c2-06e8-4750-af0a-de85197ab4f4" released by "delete_volume" :: held 0.826s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Created reservations ['57e1dc7b-a9fb-4127-aab0-c0d4a4b1b3fe', 'aed09a37-88a3-4e3f-a10d-186dcf017f6c', '36ae7e36-90b5-43c9-aeb4-1f5c8a2eb2a1', 'b9f9e018-ef6d-478d-af71-9d6190598439'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:06:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:59 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:06:59 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:59 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:06:59 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Deleted volume successfully. Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8ee68943-8e0e-42df-a301-13120ac4a75c tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-e14676c2-06e8-4750-af0a-de85197ab4f4-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Creating offline snapshot da8dbe31-e094-4255-8442-2bf791952dc3 of volume 757a68b0-4778-4415-b73e-2d562c838e27 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[827b3bd1-f583-4bd2-b3ea-406f5482c625]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:59 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 Sep 15 19:06:59 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:06:59 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27" returned: 0 in 0.438s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:06:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:06:59 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 1G Sep 15 19:06:59 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-218be919-c347-4e32-92ae-9316a46ce38c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-218be919-c347-4e32-92ae-9316a46ce38c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-quobyte-218be919-c347-4e32-92ae-9316a46ce38c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-218be919-c347-4e32-92ae-9316a46ce38c" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61e99a8-fb72-4db2-88f4-c3e63468f58b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:00 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c Sep 15 19:07:00 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:00 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 1G" returned: 0 in 0.568s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-757a68b0-4778-4415-b73e-2d562c838e27 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:00 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-757a68b0-4778-4415-b73e-2d562c838e27 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 Sep 15 19:07:00 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:00 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c" returned: 0 in 0.455s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:00 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c Sep 15 19:07:00 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:00 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-757a68b0-4778-4415-b73e-2d562c838e27 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3" returned: 0 in 0.368s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:00 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 is being set with open permissions: ugo+rw Sep 15 19:07:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:00 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 Sep 15 19:07:00 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:01 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-218be919-c347-4e32-92ae-9316a46ce38c" returned: 0 in 0.321s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-218be919-c347-4e32-92ae-9316a46ce38c" released by "delete_volume" :: held 0.849s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Created reservations ['dc6086ff-71ee-48d9-8c7f-9d67c84f5733', '78414c2a-fee9-470a-b835-f930913dfd40', 'c8a55d3a-6031-423b-b512-75160bef6481', 'e3dd8b10-d1e0-4aa2-82cd-55c59d080ef2'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:01 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3" returned: 0 in 0.322s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:01 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:01 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:01 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.info Sep 15 19:07:01 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-860f6d06-730a-462c-9335-9eff9f7a1fab-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-860f6d06-730a-462c-9335-9eff9f7a1fab-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-quobyte-860f6d06-730a-462c-9335-9eff9f7a1fab" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-860f6d06-730a-462c-9335-9eff9f7a1fab" acquired by "delete_volume" :: waited 0.024s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1dfb03-3c78-4c30-9702-c58237e644db]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:01 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.469s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:01 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Deleted volume successfully. Sep 15 19:07:01 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.info" returned: 0 in 0.448s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:01 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.info is being set with open permissions: ugo+rw Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:01 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.info Sep 15 19:07:01 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9dbec307-25ab-4b89-ac3a-1f66fb67d9d2 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-218be919-c347-4e32-92ae-9316a46ce38c-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:01 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab Sep 15 19:07:01 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:02 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.info" returned: 0 in 0.309s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3a5a1524-aade-45e3-be51-b7ac793f626c tempest-ProjectReaderTests-1438187467 None] Create snapshot completed successfully Sep 15 19:07:02 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab" returned: 0 in 0.488s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:02 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab Sep 15 19:07:02 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:02 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-860f6d06-730a-462c-9335-9eff9f7a1fab" returned: 0 in 0.288s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-860f6d06-730a-462c-9335-9eff9f7a1fab" released by "delete_volume" :: held 0.850s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Created reservations ['34440f82-8b13-4704-af6f-254e06bbe3dc', '87285c72-f3cf-4238-9faf-368c5b239d58', '77798fd3-c2bb-4ca3-8ad1-7b613020f006', '35c39fa9-1ad0-491b-84c2-130c6bf79cb4'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:02 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:02 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-d0573979-98a7-4518-8472-c492cfb30649-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-d0573979-98a7-4518-8472-c492cfb30649-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-da8dbe31-e094-4255-8442-2bf791952dc3-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-da8dbe31-e094-4255-8442-2bf791952dc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-757a68b0-4778-4415-b73e-2d562c838e27" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-757a68b0-4778-4415-b73e-2d562c838e27" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-da8dbe31-e094-4255-8442-2bf791952dc3" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "cinder-quobyte-d0573979-98a7-4518-8472-c492cfb30649" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:02 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-d0573979-98a7-4518-8472-c492cfb30649" acquired by "delete_volume" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-da8dbe31-e094-4255-8442-2bf791952dc3" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Deleting offline snapshot da8dbe31-e094-4255-8442-2bf791952dc3 of volume 757a68b0-4778-4415-b73e-2d562c838e27 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] snapshot_file for this snap is: volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.427s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[29699945-94b2-457a-a989-966ef34e46f8]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Deleted volume successfully. Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd63db2f-7980-4984-a004-bf9e92841855]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-97ee167a-5bc2-4aba-be8a-e3d30c170d74 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-860f6d06-730a-462c-9335-9eff9f7a1fab-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:03 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649 Sep 15 19:07:03 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:03 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 Sep 15 19:07:03 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:03 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649" returned: 0 in 0.457s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:03 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:03 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649 Sep 15 19:07:03 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3" returned: 0 in 0.485s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-757a68b0-4778-4415-b73e-2d562c838e27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53aee14-1c23-4fea-9707-a5fe610d5795]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:03 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 Sep 15 19:07:03 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:03 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d0573979-98a7-4518-8472-c492cfb30649" returned: 0 in 0.352s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-quobyte-d0573979-98a7-4518-8472-c492cfb30649" released by "delete_volume" :: held 0.889s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Created reservations ['674cd9c3-f1be-4eb6-9d29-4468410af4b8', 'c4c995f3-eb9f-4a74-a470-75a993c38cda', '003f9494-8adf-4aeb-a6f8-dabae21838a0', '9335aa47-cac4-4223-874e-1a9bec8caf33'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:03 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27" returned: 0 in 0.459s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:04 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 Sep 15 19:07:04 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:04 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:04 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:04 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.293s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Deleted volume successfully. Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a5ec1efb-5399-44b4-b9df-ed06dc3aa349 tempest-CreateVolumesFromImageTest-156932781 None] Lock "cinder-d0573979-98a7-4518-8472-c492cfb30649-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:04 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3" returned: 0 in 0.434s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:04 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3 Sep 15 19:07:04 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:04 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27.da8dbe31-e094-4255-8442-2bf791952dc3" returned: 0 in 0.280s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-da8dbe31-e094-4255-8442-2bf791952dc3" released by "_delete_snapshot" :: held 1.817s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-757a68b0-4778-4415-b73e-2d562c838e27" released by "delete_snapshot" :: held 1.870s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Created reservations ['621e27cf-1f57-4bb5-bfc9-bf0b17b5f2db', 'e8653d8f-7e4a-4f36-88fe-e41eac283465', 'ffef9035-48ab-44ed-9af8-61c150404287', '4c304a4c-147d-4526-a4e6-252015f08f1f'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Delete snapshot completed successfully. Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-02b7e37a-e69a-4512-94ce-bcfed0e0d31e tempest-ProjectReaderTests-1438187467 None] Lock "cinder-da8dbe31-e094-4255-8442-2bf791952dc3-delete_snapshot" released by "delete_snapshot" :: held 2.087s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-757a68b0-4778-4415-b73e-2d562c838e27-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-757a68b0-4778-4415-b73e-2d562c838e27-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-757a68b0-4778-4415-b73e-2d562c838e27" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-757a68b0-4778-4415-b73e-2d562c838e27" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3063a37-b797-46fb-b499-c4a03431ad21]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:05 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 Sep 15 19:07:05 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:05 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27" returned: 0 in 0.496s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:05 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27 Sep 15 19:07:05 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:05 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-757a68b0-4778-4415-b73e-2d562c838e27" returned: 0 in 0.347s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-757a68b0-4778-4415-b73e-2d562c838e27" released by "delete_volume" :: held 0.965s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Created reservations ['edc7f1d0-3320-4b58-b8d0-76a244c5a1ee', '28f1459a-a172-490a-9677-3fffcba3a8d9', '8f7be72b-5f78-423d-bd62-a1827be16d3c', 'b17c9220-6de6-422f-9500-42a04d69e13a'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Flow 'volume_create_manager' (e28434d5-18d8-47a6-a09b-f345aa46c70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7d69b7-3433-4ad5-ab4b-08a906f18b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7d69b7-3433-4ad5-ab4b-08a906f18b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e98a4aeb3849ca83b1baf582a14121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:06Z,use_quota=True,user_id='f22898764200478bbe3b3c4ec61ac837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3693587c-9bc2-47e2-848d-1a61a62d2f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3693587c-9bc2-47e2-848d-1a61a62d2f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d06548e-be4a-49c9-8496-a395dad7fe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.image.glance [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Creating Keystone auth plugin from conf {{(pid=86137) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:06 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:06 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (4e182b56-55a3-49eb-b814-b95d4f02fdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b40a27e-5da8-478d-b460-b00152c3732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.311s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b40a27e-5da8-478d-b460-b00152c3732d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861347073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beba600c-4db1-4b15-af6b-7eb3b85c0746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:07Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07295da-58c0-4a9b-8fbe-360d39d81645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07295da-58c0-4a9b-8fbe-360d39d81645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552a6fa8-b40a-450f-b3a7-48de01fb7690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552a6fa8-b40a-450f-b3a7-48de01fb7690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beba600c-4db1-4b15-af6b-7eb3b85c0746', 'volume_name': 'volume-beba600c-4db1-4b15-af6b-7eb3b85c0746', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae992db0-cbfb-4c2f-817d-fcaea2973656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae992db0-cbfb-4c2f-817d-fcaea2973656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d6920c-04bb-431e-b0aa-36527beb953f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Volume beba600c-4db1-4b15-af6b-7eb3b85c0746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beba600c-4db1-4b15-af6b-7eb3b85c0746', 'volume_size': 1} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1861347073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beba600c-4db1-4b15-af6b-7eb3b85c0746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:07Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Creating volume beba600c-4db1-4b15-af6b-7eb3b85c0746 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:06 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:06 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Deleted volume successfully. Sep 15 19:07:06 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 1073741824 Sep 15 19:07:06 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-54a62c6c-2602-4712-b92e-1bd39614e9e3 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-757a68b0-4778-4415-b73e-2d562c838e27-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d06548e-be4a-49c9-8496-a395dad7fe69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1b4bedf-85b2-4ce3-8d38-4562fadd3e2a', 'volume_name': 'volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a', 'volume_size': 1, 'image_id': '22689806-ec22-49f3-922a-6c94648d68b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22689806-ec22-49f3-922a-6c94648d68b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b85617035d5248286e04def433b9beae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f9e98a4aeb3849ca83b1baf582a14121', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '454a74e2cebb4347e693bf55fb9ba380c6612790ed253d8658be3b00b60d07f6d52b278b50fa8e3904d85b3ea9400660de773e622bd7ad57c1fff6eec8f161b7', 'id': '22689806-ec22-49f3-922a-6c94648d68b8', 'created_at': datetime.datetime(2026, 9, 15, 17, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 17, 7, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22689806-ec22-49f3-922a-6c94648d68b8/file', 'properties': {}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652475a0-ec5f-4650-aa9d-58a183c385af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652475a0-ec5f-4650-aa9d-58a183c385af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30216cc8-bae4-42f0-b2c1-19cd3f2f1fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:06 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Volume d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a', 'volume_size': 1, 'image_id': '22689806-ec22-49f3-922a-6c94648d68b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22689806-ec22-49f3-922a-6c94648d68b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b85617035d5248286e04def433b9beae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f9e98a4aeb3849ca83b1baf582a14121', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '454a74e2cebb4347e693bf55fb9ba380c6612790ed253d8658be3b00b60d07f6d52b278b50fa8e3904d85b3ea9400660de773e622bd7ad57c1fff6eec8f161b7', 'id': '22689806-ec22-49f3-922a-6c94648d68b8', 'created_at': datetime.datetime(2026, 9, 15, 17, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 17, 7, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22689806-ec22-49f3-922a-6c94648d68b8/file', 'properties': {}}, 'image_service': } Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Trying to clone d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a from image 22689806-ec22-49f3-922a-6c94648d68b8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/22689806-ec22-49f3-922a-6c94648d68b8', 'metadata': {}}]). {{(pid=86137) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 19:07:06 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 15 19:07:06 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Image download 0.00 MB at 0.00 MB/s Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86980b6-f37e-412d-ba3b-2fe158a12c82]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:07 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD Sep 15 19:07:07 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:07 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 1073741824" returned: 0 in 0.586s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:07 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 Sep 15 19:07:07 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:07 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:07 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD Sep 15 19:07:07 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:07 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746" returned: 0 in 0.356s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d6920c-04bb-431e-b0aa-36527beb953f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beba600c-4db1-4b15-af6b-7eb3b85c0746', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee3cc56-b443-4539-b8d3-95bc12701fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Volume volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 (beba600c-4db1-4b15-af6b-7eb3b85c0746): created successfully Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee3cc56-b443-4539-b8d3-95bc12701fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (4e182b56-55a3-49eb-b814-b95d4f02fdfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a797ea12-fde1-48db-b35b-673b1cae509a tempest-ProjectMemberTests-715700841 None] Created volume successfully. Sep 15 19:07:07 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD" returned: 1 in 0.428s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Temporary image 22689806-ec22-49f3-922a-6c94648d68b8 is fetched for user f22898764200478bbe3b3c4ec61ac837. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (a99e7619-d8d7-4527-ab73-4e1a84a77c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6661e8ee-e86a-4512-b9ef-a3cd65ee1701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6661e8ee-e86a-4512-b9ef-a3cd65ee1701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830368559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af029912-7ada-4412-b936-9b35ce849142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:08Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bf091d-351e-4a78-a081-56be0fa7fa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31bf091d-351e-4a78-a081-56be0fa7fa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49482598-f5b1-44fb-882f-59dcaa1d3b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49482598-f5b1-44fb-882f-59dcaa1d3b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af029912-7ada-4412-b936-9b35ce849142', 'volume_name': 'volume-af029912-7ada-4412-b936-9b35ce849142', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be02f1e-0e03-48e6-aec5-e4d4f8d95a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be02f1e-0e03-48e6-aec5-e4d4f8d95a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d182354e-d5f7-4f97-89c6-8ac91e9a45f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Volume af029912-7ada-4412-b936-9b35ce849142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af029912-7ada-4412-b936-9b35ce849142', 'volume_size': 1} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830368559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af029912-7ada-4412-b936-9b35ce849142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:08Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Creating volume af029912-7ada-4412-b936-9b35ce849142 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:08 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:08 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 1073741824 Sep 15 19:07:08 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d519de2b-7e76-497a-b5c3-3f541d9d9338]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:08 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD Sep 15 19:07:08 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:08 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:08 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 1073741824" returned: 0 in 0.520s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:08 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD Sep 15 19:07:08 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:08 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 Sep 15 19:07:08 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Flow 'volume_create_manager' (60290b8e-1119-41a2-a083-8379744c3496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cd47c8-142d-4d84-b385-c0c8577f1c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cd47c8-142d-4d84-b385-c0c8577f1c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1119991441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dcc873-4b79-4efd-8265-3b4c0d82e289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da7ef69ffa4455dbaf293a906428660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:09Z,use_quota=True,user_id='15fd9398b19e4ac5a32efb05c5661235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4c01eb-5350-4f1a-bb7c-fb71e044c064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4c01eb-5350-4f1a-bb7c-fb71e044c064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:08 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c8314c-18b6-4589-afad-741d7b3aab26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c8314c-18b6-4589-afad-741d7b3aab26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01dcc873-4b79-4efd-8265-3b4c0d82e289', 'volume_name': 'volume-01dcc873-4b79-4efd-8265-3b4c0d82e289', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20618135-720d-4095-add9-8e3ecff9a1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20618135-720d-4095-add9-8e3ecff9a1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b70b9b5-4aed-4cb9-8e61-d5bf30d4a2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:08 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Volume 01dcc873-4b79-4efd-8265-3b4c0d82e289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01dcc873-4b79-4efd-8265-3b4c0d82e289', 'volume_size': 1} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:08 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142" returned: 0 in 0.302s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.053s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1119991441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01dcc873-4b79-4efd-8265-3b4c0d82e289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da7ef69ffa4455dbaf293a906428660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:09Z,use_quota=True,user_id='15fd9398b19e4ac5a32efb05c5661235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Creating volume 01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:08 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d182354e-d5f7-4f97-89c6-8ac91e9a45f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af029912-7ada-4412-b936-9b35ce849142', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d54be6a-6f7f-4ed7-93d9-dfbd2d5aa012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:08 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 1073741824 Sep 15 19:07:08 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:08 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Volume volume-af029912-7ada-4412-b936-9b35ce849142 (af029912-7ada-4412-b936-9b35ce849142): created successfully Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d54be6a-6f7f-4ed7-93d9-dfbd2d5aa012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:08 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (a99e7619-d8d7-4527-ab73-4e1a84a77c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:08 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7d4e6b61-a9f5-4182-839a-b16753472aba tempest-ProjectReaderTests-1438187467 None] Created volume successfully. Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:09 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 1073741824" returned: 0 in 0.441s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:09 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 Sep 15 19:07:09 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:09 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289" returned: 0 in 0.249s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9e98a4aeb3849ca83b1baf582a14121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:06Z,use_quota=True,user_id='f22898764200478bbe3b3c4ec61ac837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Creating volume d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:09 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b70b9b5-4aed-4cb9-8e61-d5bf30d4a2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01dcc873-4b79-4efd-8265-3b4c0d82e289', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:09 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a 1073741824 Sep 15 19:07:09 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6e3ffc-f748-4b9a-bfd2-d88899919a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:09 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Volume volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 (01dcc873-4b79-4efd-8265-3b4c0d82e289): created successfully Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6e3ffc-f748-4b9a-bfd2-d88899919a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Flow 'volume_create_manager' (60290b8e-1119-41a2-a083-8379744c3496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:09 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-96b31836-12fe-48c6-a739-0afecdbf7844 tempest-VolumeDependencyTests-1411314039 None] Created volume successfully. Sep 15 19:07:10 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a 1073741824" returned: 0 in 0.442s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:10 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a Sep 15 19:07:10 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:10 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a" returned: 0 in 0.249s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.221s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Creating offline snapshot 2db96e58-85cc-43dc-8048-3cf81c09d57b of volume beba600c-4db1-4b15-af6b-7eb3b85c0746 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Attempting download of 22689806-ec22-49f3-922a-6c94648d68b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/22689806-ec22-49f3-922a-6c94648d68b8', 'metadata': {}}])) to volume d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d607a0de-0c23-4538-b9da-75ac393209b7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d0390e-0220-4445-8541-dfa9794805a8]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22689806-ec22-49f3-922a-6c94648d68b8_m2mn9c8s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:10 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 Sep 15 19:07:10 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:10 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22689806-ec22-49f3-922a-6c94648d68b8_m2mn9c8s Sep 15 19:07:10 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:10 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22689806-ec22-49f3-922a-6c94648d68b8_m2mn9c8s" returned: 0 in 0.349s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22689806-ec22-49f3-922a-6c94648d68b8_m2mn9c8s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:10 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746" returned: 0 in 0.404s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:10 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b 1G Sep 15 19:07:10 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:10 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22689806-ec22-49f3-922a-6c94648d68b8_m2mn9c8s Sep 15 19:07:10 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:11 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22689806-ec22-49f3-922a-6c94648d68b8_m2mn9c8s" returned: 1 in 0.356s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22689806-ec22-49f3-922a-6c94648d68b8_m2mn9c8s' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc05dcd-06df-4a64-a50d-16f97da3607a]: (4, 'raw') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:11 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b 1G" returned: 0 in 0.429s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:11 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD Sep 15 19:07:11 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:11 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b Sep 15 19:07:11 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:11 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:11 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b" returned: 0 in 0.292s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:11 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b is being set with open permissions: ugo+rw Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:11 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b Sep 15 19:07:11 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:11 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD Sep 15 19:07:11 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:11 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b" returned: 0 in 0.249s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:11 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD" returned: 1 in 0.321s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] 22689806-ec22-49f3-922a-6c94648d68b8 was raw, converting to qcow2 {{(pid=86137) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:11 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a Sep 15 19:07:11 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:11 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.info Sep 15 19:07:11 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:12 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.info" returned: 0 in 0.269s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:12 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.info is being set with open permissions: ugo+rw Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:12 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.info Sep 15 19:07:12 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:12 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a" returned: 0 in 0.473s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22689806-ec22-49f3-922a-6c94648d68b8_c4lk5jm1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 19:07:12 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Converted 0.00 MB image at 0.00 MB/s Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:12 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a 1G Sep 15 19:07:12 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:12 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.info" returned: 0 in 0.264s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.239s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Creating offline snapshot c9fcaa68-0983-47a6-b2fb-0304b4529e98 of volume af029912-7ada-4412-b936-9b35ce849142 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:07:12 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-69437433-c788-4d37-a167-5a9abd2bf961 tempest-ProjectMemberTests-715700841 None] Create snapshot completed successfully Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc806fe8-eb10-45a4-bb9b-ebfe6df61522]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:12 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 Sep 15 19:07:12 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:12 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a 1G" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Downloaded image 22689806-ec22-49f3-922a-6c94648d68b8 ((None, [{'url': 'file:///opt/stack/data/glance/images/22689806-ec22-49f3-922a-6c94648d68b8', 'metadata': {}}])) to volume d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a successfully. {{(pid=86137) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Temporary image 22689806-ec22-49f3-922a-6c94648d68b8 for user f22898764200478bbe3b3c4ec61ac837 is deleted. {{(pid=86137) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.volume.volume_utils [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Marking volume d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a as bootable. {{(pid=86137) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Copying metadata from image 22689806-ec22-49f3-922a-6c94648d68b8 to d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a. {{(pid=86137) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Creating volume glance metadata for volume d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a backed by image 22689806-ec22-49f3-922a-6c94648d68b8 with: {'image_id': '22689806-ec22-49f3-922a-6c94648d68b8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b85617035d5248286e04def433b9beae', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86137) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30216cc8-bae4-42f0-b2c1-19cd3f2f1fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a', 'volume_size': 1, 'image_id': '22689806-ec22-49f3-922a-6c94648d68b8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22689806-ec22-49f3-922a-6c94648d68b8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b85617035d5248286e04def433b9beae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f9e98a4aeb3849ca83b1baf582a14121', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '454a74e2cebb4347e693bf55fb9ba380c6612790ed253d8658be3b00b60d07f6d52b278b50fa8e3904d85b3ea9400660de773e622bd7ad57c1fff6eec8f161b7', 'id': '22689806-ec22-49f3-922a-6c94648d68b8', 'created_at': datetime.datetime(2026, 9, 15, 17, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 17, 7, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22689806-ec22-49f3-922a-6c94648d68b8/file', 'properties': {}}, 'image_service': }' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdf6365-89ce-4eb2-8baa-22f8f95b00a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:12 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Volume volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a (d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a): created successfully Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdf6365-89ce-4eb2-8baa-22f8f95b00a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Flow 'volume_create_manager' (e28434d5-18d8-47a6-a09b-f345aa46c70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:12 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-06c2f244-6631-469e-a9b2-af504effccce tempest-VolumeImageDependencyTests-852289308 None] Created volume successfully. Sep 15 19:07:12 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142" returned: 0 in 0.386s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:12 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 1G Sep 15 19:07:12 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:13 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 1G" returned: 0 in 0.378s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af029912-7ada-4412-b936-9b35ce849142 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:13 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af029912-7ada-4412-b936-9b35ce849142 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 Sep 15 19:07:13 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-2db96e58-85cc-43dc-8048-3cf81c09d57b-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Lock "cinder-2db96e58-85cc-43dc-8048-3cf81c09d57b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-beba600c-4db1-4b15-af6b-7eb3b85c0746" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-beba600c-4db1-4b15-af6b-7eb3b85c0746" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-2db96e58-85cc-43dc-8048-3cf81c09d57b" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-2db96e58-85cc-43dc-8048-3cf81c09d57b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Deleting offline snapshot 2db96e58-85cc-43dc-8048-3cf81c09d57b of volume beba600c-4db1-4b15-af6b-7eb3b85c0746 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] snapshot_file for this snap is: volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4991ceff-c7b8-47db-accf-a736b180700e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:13 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af029912-7ada-4412-b936-9b35ce849142 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98" returned: 0 in 0.304s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:13 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 is being set with open permissions: ugo+rw Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:13 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b Sep 15 19:07:13 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:13 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 Sep 15 19:07:13 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Acquiring lock "cinder-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Lock "cinder-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Acquiring lock "cinder-quobyte-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Lock "cinder-quobyte-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:13 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98" returned: 0 in 0.255s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[972b3547-e3ee-440d-9254-dde129e2055e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:13 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b" returned: 0 in 0.432s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beba600c-4db1-4b15-af6b-7eb3b85c0746(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:13 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.info Sep 15 19:07:13 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e3dc5d-c55a-4cb9-911f-5db04731b87b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:13 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a Sep 15 19:07:13 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:14 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 Sep 15 19:07:14 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:14 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.info" returned: 0 in 0.292s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:14 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.info is being set with open permissions: ugo+rw Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:14 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.info Sep 15 19:07:14 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:14 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a" returned: 0 in 0.406s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:14 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a Sep 15 19:07:14 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:14 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746" returned: 0 in 0.423s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:14 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b Sep 15 19:07:14 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:14 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.info" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.465s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Creating offline snapshot 756873bc-1042-4916-b3cc-a3de6a77d3cd of volume 01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:07:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a7c8d440-b328-45f6-bfa2-c58eec984aa6 tempest-ProjectReaderTests-1438187467 None] Create snapshot completed successfully Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8400f7-091c-4416-9fe9-3f2c9ec46513]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:14 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a" returned: 0 in 0.292s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Lock "cinder-quobyte-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a" released by "delete_volume" :: held 0.749s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Created reservations ['0227a683-815a-4076-97ec-179b2e46d0f4', 'bb10e772-facb-401a-b1cb-451a2844eeec', '90a49e52-cf82-4b6d-90c1-3d0f038575b3', '6c2a4156-04f8-43ac-86b6-fb111295823e'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:14 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 Sep 15 19:07:14 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:14 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:14 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:14 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b" returned: 0 in 0.389s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:14 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b Sep 15 19:07:14 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:14 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289" returned: 0 in 0.421s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:14 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd 1G Sep 15 19:07:14 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:14 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.291s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:14 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Deleted volume successfully. Sep 15 19:07:14 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-bef180b1-9709-45f5-b1b0-137ab0b358ce tempest-VolumeImageDependencyTests-852289308 None] Lock "cinder-d1b4bedf-85b2-4ce3-8d38-4562fadd3e2a-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:15 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746.2db96e58-85cc-43dc-8048-3cf81c09d57b" returned: 0 in 0.318s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-2db96e58-85cc-43dc-8048-3cf81c09d57b" released by "_delete_snapshot" :: held 1.708s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-beba600c-4db1-4b15-af6b-7eb3b85c0746" released by "delete_snapshot" :: held 1.735s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Created reservations ['9aec29d0-6f77-47d7-a43c-13d34f0b1a40', 'a0520f0d-2245-4dc0-ad79-cd740ab8b7b4', 'da044873-c6ec-4785-81d4-33d34c9d4275', '85c37ab8-33dc-4806-baba-0c2c6c561aea'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Delete snapshot completed successfully. Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-95c609ce-2b7d-4c30-9bf1-f2aab781fe64 tempest-ProjectMemberTests-715700841 None] Lock "cinder-2db96e58-85cc-43dc-8048-3cf81c09d57b-delete_snapshot" released by "delete_snapshot" :: held 1.893s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:15 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd 1G" returned: 0 in 0.506s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-c9fcaa68-0983-47a6-b2fb-0304b4529e98-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:15 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd Sep 15 19:07:15 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Lock "cinder-c9fcaa68-0983-47a6-b2fb-0304b4529e98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-af029912-7ada-4412-b936-9b35ce849142" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-af029912-7ada-4412-b936-9b35ce849142" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-c9fcaa68-0983-47a6-b2fb-0304b4529e98" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-c9fcaa68-0983-47a6-b2fb-0304b4529e98" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Deleting offline snapshot c9fcaa68-0983-47a6-b2fb-0304b4529e98 of volume af029912-7ada-4412-b936-9b35ce849142 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] snapshot_file for this snap is: volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-beba600c-4db1-4b15-af6b-7eb3b85c0746-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e86fd8d-54b6-4a66-afef-a0669f4aba93]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Lock "cinder-beba600c-4db1-4b15-af6b-7eb3b85c0746-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-beba600c-4db1-4b15-af6b-7eb3b85c0746" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-beba600c-4db1-4b15-af6b-7eb3b85c0746" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:15 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 Sep 15 19:07:15 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a644b0f3-cfb6-479c-8d33-ac0726cd7d8b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:15 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd" returned: 0 in 0.381s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:15 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd is being set with open permissions: ugo+rw Sep 15 19:07:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:15 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd Sep 15 19:07:15 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:15 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 Sep 15 19:07:15 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:16 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98" returned: 0 in 0.559s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af029912-7ada-4412-b936-9b35ce849142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0997047f-ccdf-4865-8950-b955f8942fef]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:16 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd" returned: 0 in 0.377s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:16 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.info Sep 15 19:07:16 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:16 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746" returned: 0 in 0.539s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:16 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 Sep 15 19:07:16 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:16 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746 Sep 15 19:07:16 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:16 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.info" returned: 0 in 0.343s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:16 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.info is being set with open permissions: ugo+rw Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:16 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.info Sep 15 19:07:16 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:16 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-beba600c-4db1-4b15-af6b-7eb3b85c0746" returned: 0 in 0.325s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-beba600c-4db1-4b15-af6b-7eb3b85c0746" released by "delete_volume" :: held 0.958s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:16 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142" returned: 0 in 0.500s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:16 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 Sep 15 19:07:16 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Created reservations ['b697f39a-a6e8-457a-bd1d-4b489673b2cf', 'da2c7b8c-1d3e-4db8-b4f6-2cf091a36652', 'c72c26a4-689f-4944-9ad0-05806f385c74', 'a0c0060c-19aa-4e45-bba8-4951b62ac3c3'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:16 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:16 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:16 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.info" returned: 0 in 0.385s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.534s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:16 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-add4adb6-950a-4dbf-b8c1-6f4c17283b84 tempest-VolumeDependencyTests-1411314039 None] Create snapshot completed successfully Sep 15 19:07:17 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98" returned: 0 in 0.434s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:17 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98 Sep 15 19:07:17 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:17 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.306s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:17 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Deleted volume successfully. Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-cb7c4b0b-e455-4803-b787-1e0b0fcf9e45 tempest-ProjectMemberTests-715700841 None] Lock "cinder-beba600c-4db1-4b15-af6b-7eb3b85c0746-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:17 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142.c9fcaa68-0983-47a6-b2fb-0304b4529e98" returned: 0 in 0.296s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-c9fcaa68-0983-47a6-b2fb-0304b4529e98" released by "_delete_snapshot" :: held 1.932s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-af029912-7ada-4412-b936-9b35ce849142" released by "delete_snapshot" :: held 1.960s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Created reservations ['fc2aced4-037f-4c49-a50e-a9c1376fddfd', '6466f2df-c7c1-49ca-90aa-1fc5fa849d21', '4b4fb73e-91da-4da3-b96d-d397f2740bae', '8a7a7928-43ae-41c2-990d-3010dd6c9a8b'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:17 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Delete snapshot completed successfully. Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8a11f513-d276-4a69-88de-0be346afb3dc tempest-ProjectReaderTests-1438187467 None] Lock "cinder-c9fcaa68-0983-47a6-b2fb-0304b4529e98-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-af029912-7ada-4412-b936-9b35ce849142-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-af029912-7ada-4412-b936-9b35ce849142-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-af029912-7ada-4412-b936-9b35ce849142" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-af029912-7ada-4412-b936-9b35ce849142" acquired by "delete_volume" :: waited 0.031s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd406ff-27a3-47bc-b7bb-d672b2ac7f50]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Flow 'volume_create_manager' (205c8fc5-64f6-4a48-a04a-651c06b39276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8183272f-3e15-4d8d-ad82-ac949d75d203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8183272f-3e15-4d8d-ad82-ac949d75d203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1504308063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f8ae36-0ff6-4fe3-a021-e4e35d169353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da7ef69ffa4455dbaf293a906428660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=756873bc-1042-4916-b3cc-a3de6a77d3cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:18Z,use_quota=True,user_id='15fd9398b19e4ac5a32efb05c5661235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc0bb77-7db1-46ee-98bc-91f0fda66e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc0bb77-7db1-46ee-98bc-91f0fda66e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054f33e9-1eae-47c7-806d-f382e73496cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (054f33e9-1eae-47c7-806d-f382e73496cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45f8ae36-0ff6-4fe3-a021-e4e35d169353', 'volume_name': 'volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353', 'volume_size': 1, 'snapshot_id': '756873bc-1042-4916-b3cc-a3de6a77d3cd'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a484e1-3999-4dbc-8818-278a84504874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a484e1-3999-4dbc-8818-278a84504874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed971b7-f2e0-4569-9175-ae2452321624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:17 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Volume 45f8ae36-0ff6-4fe3-a021-e4e35d169353: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353', 'volume_size': 1, 'snapshot_id': '756873bc-1042-4916-b3cc-a3de6a77d3cd'} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "cinder-quobyte-756873bc-1042-4916-b3cc-a3de6a77d3cd-45f8ae36-0ff6-4fe3-a021-e4e35d169353" by "_create_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:17 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 Sep 15 19:07:17 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-756873bc-1042-4916-b3cc-a3de6a77d3cd-45f8ae36-0ff6-4fe3-a021-e4e35d169353" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Creating volume 45f8ae36-0ff6-4fe3-a021-e4e35d169353 from snapshot 756873bc-1042-4916-b3cc-a3de6a77d3cd {{(pid=86137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:17 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "cinder-quobyte-45f8ae36-0ff6-4fe3-a021-e4e35d169353" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-45f8ae36-0ff6-4fe3-a021-e4e35d169353" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] snapshot: 756873bc-1042-4916-b3cc-a3de6a77d3cd, volume: 45f8ae36-0ff6-4fe3-a021-e4e35d169353, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[772637e0-88fe-46f9-a553-6888f8b9cb46]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:18 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd Sep 15 19:07:18 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:18 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142" returned: 0 in 0.537s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:18 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142 Sep 15 19:07:18 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (725756e8-2606-496d-b0de-768c45e33ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3ec405-e731-4dcb-aa6d-2d2026d6a35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3ec405-e731-4dcb-aa6d-2d2026d6a35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727592807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7163859-6b48-4f05-89e1-fd9b0ddb7d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:18Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b5f798-06ca-486c-aafd-70f716197bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b5f798-06ca-486c-aafd-70f716197bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b37396-9b46-4885-b900-6528b63dc6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b37396-9b46-4885-b900-6528b63dc6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7163859-6b48-4f05-89e1-fd9b0ddb7d19', 'volume_name': 'volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9236cc5-bb56-4341-81d7-51dd41fc1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9236cc5-bb56-4341-81d7-51dd41fc1d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2be0f10-5107-4613-aaa8-bec2425546b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Volume d7163859-6b48-4f05-89e1-fd9b0ddb7d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19', 'volume_size': 1} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:18 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd" returned: 0 in 0.441s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01dcc873-4b79-4efd-8265-3b4c0d82e289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b2892-ff99-4920-ae3f-81a10c280281]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:18 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-af029912-7ada-4412-b936-9b35ce849142" returned: 0 in 0.335s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:18 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 Sep 15 19:07:18 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-af029912-7ada-4412-b936-9b35ce849142" released by "delete_volume" :: held 1.001s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Created reservations ['1107ddca-5de2-4dcd-a344-62e0ac21437e', '8aa244d8-bffb-4a5a-98a4-773066b2e5b5', '9da9a6c3-bdac-4411-aa21-ec45101cd571', 'bce7ccd3-f9ab-48a8-b983-80dc600da054'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Flow 'volume_create_manager' (75904f14-e14e-4763-bf2f-e4f63e7a7dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331f3393-5196-4dc0-8c4d-ffef7e606401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331f3393-5196-4dc0-8c4d-ffef7e606401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7af763-f248-4a73-a062-757829a8e856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cb4d6c50954b248f758c9b660a74d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:19Z,use_quota=True,user_id='1f4b6ec64b584af683348bfd2996aa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3b5537-d873-4760-8504-b236c3e79288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3b5537-d873-4760-8504-b236c3e79288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5917c6e4-801a-4c93-996f-6fd838e9dcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5917c6e4-801a-4c93-996f-6fd838e9dcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7af763-f248-4a73-a062-757829a8e856', 'volume_name': 'volume-3b7af763-f248-4a73-a062-757829a8e856', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcd7215-504b-49f1-82fe-663093dc3394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcd7215-504b-49f1-82fe-663093dc3394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d56cdbe-1cd0-4be6-8c55-47caa842d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:18 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Volume 3b7af763-f248-4a73-a062-757829a8e856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7af763-f248-4a73-a062-757829a8e856', 'volume_size': 1} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:19 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:19 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:19 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289" returned: 0 in 0.444s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 19:07:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 19:07:19 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 19:07:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:19 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 Sep 15 19:07:19 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:19 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.245s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:19 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:19 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Deleted volume successfully. Sep 15 19:07:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-d5d086d6-dd9d-4c5b-9a42-d4637a38f9a8 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-af029912-7ada-4412-b936-9b35ce849142-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (65f9c2b9-8ea0-4134-9fd4-63780b5778a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c508320e-ab29-49af-b6d8-b3bf76ac8741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c508320e-ab29-49af-b6d8-b3bf76ac8741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619478673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d9d542-6f5a-4783-87b0-00716ef983c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:21Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69f73c3-22ca-47b9-8a3e-d295ed49e65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69f73c3-22ca-47b9-8a3e-d295ed49e65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecb2677-aa5b-492b-83c2-4539d0c06130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ecb2677-aa5b-492b-83c2-4539d0c06130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d9d542-6f5a-4783-87b0-00716ef983c0', 'volume_name': 'volume-c3d9d542-6f5a-4783-87b0-00716ef983c0', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdc0840-d3fb-450e-a24c-49235b5f92ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fdc0840-d3fb-450e-a24c-49235b5f92ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a07758-9801-46a6-adfd-cd201cb01ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:20 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Volume c3d9d542-6f5a-4783-87b0-00716ef983c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d9d542-6f5a-4783-87b0-00716ef983c0', 'volume_size': 1} Sep 15 19:07:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:25 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353" returned: 0 in 6.251s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289, size 1024.00 MB, duration 6.25 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 19:07:25 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Converted 1024.00 MB image at 163.78 MB/s Sep 15 19:07:25 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 is being set with open permissions: ugo+rw Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:25 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 Sep 15 19:07:25 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:25 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353" returned: 0 in 0.250s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-45f8ae36-0ff6-4fe3-a021-e4e35d169353" released by "_copy_volume_from_snapshot" :: held 7.519s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=318,cinder:SELECT=225,cinder:INSERT=89,cinder:DELETE=30 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=249,cinder:UPDATE=315,cinder:INSERT=82,cinder:DELETE=26 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-756873bc-1042-4916-b3cc-a3de6a77d3cd-45f8ae36-0ff6-4fe3-a021-e4e35d169353" released by "_create_volume_from_snapshot" :: held 7.600s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.623s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.082s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1727592807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7163859-6b48-4f05-89e1-fd9b0ddb7d19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:18Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Creating volume d7163859-6b48-4f05-89e1-fd9b0ddb7d19 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:25 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:25 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 1073741824 Sep 15 19:07:25 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed971b7-f2e0-4569-9175-ae2452321624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353', 'volume_size': 1, 'snapshot_id': '756873bc-1042-4916-b3cc-a3de6a77d3cd'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f9e4ba-2237-415f-8227-ee3deab7a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:25 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Volume volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 (45f8ae36-0ff6-4fe3-a021-e4e35d169353): created successfully Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f9e4ba-2237-415f-8227-ee3deab7a26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:25 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Flow 'volume_create_manager' (205c8fc5-64f6-4a48-a04a-651c06b39276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:25 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-62eff91a-4cbf-4443-8417-802af1301d1a tempest-VolumeDependencyTests-1411314039 None] Created volume successfully. Sep 15 19:07:26 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 1073741824" returned: 0 in 0.420s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:26 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 Sep 15 19:07:26 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:26 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" returned: 0 in 0.253s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.356s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7af763-f248-4a73-a062-757829a8e856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cb4d6c50954b248f758c9b660a74d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:19Z,use_quota=True,user_id='1f4b6ec64b584af683348bfd2996aa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Creating volume 3b7af763-f248-4a73-a062-757829a8e856 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:26 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2be0f10-5107-4613-aaa8-bec2425546b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d1029a-a377-475f-a482-6fa5c812d3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:26 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856 1073741824 Sep 15 19:07:26 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:26 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Volume volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 (d7163859-6b48-4f05-89e1-fd9b0ddb7d19): created successfully Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d1029a-a377-475f-a482-6fa5c812d3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (725756e8-2606-496d-b0de-768c45e33ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:26 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-81331d7f-16ee-48ff-b44e-f441eabdfd63 tempest-ProjectMemberTests-715700841 None] Created volume successfully. Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "cinder-756873bc-1042-4916-b3cc-a3de6a77d3cd-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-756873bc-1042-4916-b3cc-a3de6a77d3cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "cinder-quobyte-01dcc873-4b79-4efd-8265-3b4c0d82e289" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-01dcc873-4b79-4efd-8265-3b4c0d82e289" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "cinder-quobyte-756873bc-1042-4916-b3cc-a3de6a77d3cd" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-756873bc-1042-4916-b3cc-a3de6a77d3cd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Deleting offline snapshot 756873bc-1042-4916-b3cc-a3de6a77d3cd of volume 01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] snapshot_file for this snap is: volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcba72c3-db22-4140-a0e0-c28c01ed2894]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:26 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd Sep 15 19:07:26 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:26 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856 1073741824" returned: 0 in 0.449s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:26 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856 Sep 15 19:07:26 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:27 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd" returned: 0 in 0.426s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01dcc873-4b79-4efd-8265-3b4c0d82e289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[433cee5a-d3b7-4804-b240-1a4243ca5425]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:27 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856" returned: 0 in 0.305s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.290s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619478673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d9d542-6f5a-4783-87b0-00716ef983c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0299808877234fad911167e860ef5c8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:21Z,use_quota=True,user_id='e85910d2cb7a4c7b9e5c093123d444e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Creating volume c3d9d542-6f5a-4783-87b0-00716ef983c0 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:27 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d56cdbe-1cd0-4be6-8c55-47caa842d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7af763-f248-4a73-a062-757829a8e856', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4eb579-4b27-4b8d-976d-37767b566af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:27 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 1073741824 Sep 15 19:07:27 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:27 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Volume volume-3b7af763-f248-4a73-a062-757829a8e856 (3b7af763-f248-4a73-a062-757829a8e856): created successfully Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4eb579-4b27-4b8d-976d-37767b566af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Flow 'volume_create_manager' (75904f14-e14e-4763-bf2f-e4f63e7a7dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:27 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e767dd96-1d29-47ad-8a9b-1f329ae25d89 tempest-CinderUnicodeTest-1362066862 None] Created volume successfully. Sep 15 19:07:27 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 Sep 15 19:07:27 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:27 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 1073741824" returned: 0 in 0.498s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:27 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289" returned: 0 in 0.587s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:27 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd Sep 15 19:07:27 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:27 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 Sep 15 19:07:27 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:27 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0" returned: 0 in 0.273s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.814s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a07758-9801-46a6-adfd-cd201cb01ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d9d542-6f5a-4783-87b0-00716ef983c0', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:27 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15438a5f-99b7-4c8d-a278-a04342c6b57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Creating offline snapshot df421066-cd66-41f7-bae5-ba0ed36704d5 of volume d7163859-6b48-4f05-89e1-fd9b0ddb7d19 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:07:28 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Volume volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 (c3d9d542-6f5a-4783-87b0-00716ef983c0): created successfully Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15438a5f-99b7-4c8d-a278-a04342c6b57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Flow 'volume_create_manager' (65f9c2b9-8ea0-4134-9fd4-63780b5778a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[500b2185-f5de-4cab-b23f-6bbf39550235]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e7c02c39-9654-432f-ba12-b12c3a1b89c9 tempest-ProjectReaderTests-1438187467 None] Created volume successfully. Sep 15 19:07:28 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd" returned: 0 in 0.419s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:28 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Flow 'volume_create_manager' (443970e9-309b-4f36-91ee-eca593360201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:28 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce9a22c-809d-4481-8a54-595d9e13cf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bce9a22c-809d-4481-8a54-595d9e13cf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-37289764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10752a06-f71b-46ba-985d-3e845b2d6f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cb4d6c50954b248f758c9b660a74d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:28Z,use_quota=True,user_id='1f4b6ec64b584af683348bfd2996aa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05ca072-2d09-4c67-ac6e-8a64035d10b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05ca072-2d09-4c67-ac6e-8a64035d10b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:28 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 Sep 15 19:07:28 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35c4ad3-acea-499c-9250-af7f607f28d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35c4ad3-acea-499c-9250-af7f607f28d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10752a06-f71b-46ba-985d-3e845b2d6f1a', 'volume_name': 'volume-10752a06-f71b-46ba-985d-3e845b2d6f1a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fc76ed-ae90-4f62-87ef-e614e2c73e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fc76ed-ae90-4f62-87ef-e614e2c73e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142058f8-5fcd-4b94-b655-9f09cc3750f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:28 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Volume 10752a06-f71b-46ba-985d-3e845b2d6f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10752a06-f71b-46ba-985d-3e845b2d6f1a', 'volume_size': 1} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:28 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289.756873bc-1042-4916-b3cc-a3de6a77d3cd" returned: 0 in 0.274s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-756873bc-1042-4916-b3cc-a3de6a77d3cd" released by "_delete_snapshot" :: held 1.838s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-01dcc873-4b79-4efd-8265-3b4c0d82e289" released by "delete_snapshot" :: held 1.867s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:28 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" returned: 0 in 0.380s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:28 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 1G Sep 15 19:07:28 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Created reservations ['20486066-11f6-470e-8d7b-d846dd17a603', '415e9e58-027d-43a3-9dcf-50b48f7da983', 'e7d556d4-8a46-4181-a4fe-cb8a6e1eae1e', '36e2c452-7247-42aa-bc59-ad866c951669'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:28 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Delete snapshot completed successfully. Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-7f0de598-6d37-459a-9fb3-752947b8e4fa tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-756873bc-1042-4916-b3cc-a3de6a77d3cd-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "cinder-01dcc873-4b79-4efd-8265-3b4c0d82e289-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-01dcc873-4b79-4efd-8265-3b4c0d82e289-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "cinder-quobyte-01dcc873-4b79-4efd-8265-3b4c0d82e289" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-01dcc873-4b79-4efd-8265-3b4c0d82e289" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee327ed6-03fe-42a1-b6d3-30237897b0d5]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:28 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 1G" returned: 0 in 0.454s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:28 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 Sep 15 19:07:28 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:28 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 Sep 15 19:07:28 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:29 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:29 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5" returned: 0 in 0.322s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:29 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 is being set with open permissions: ugo+rw Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289" returned: 0 in 0.422s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:29 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 Sep 15 19:07:29 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:29 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289 Sep 15 19:07:29 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:29 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5" returned: 0 in 0.257s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:29 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-01dcc873-4b79-4efd-8265-3b4c0d82e289" returned: 0 in 0.279s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:29 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.info Sep 15 19:07:29 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-01dcc873-4b79-4efd-8265-3b4c0d82e289" released by "delete_volume" :: held 0.772s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Created reservations ['d4d1c51d-407f-4425-aebb-a223a5fbf204', 'e171f6f6-f707-4899-a6de-2f3dc5f18f26', 'ebdffad5-6871-4903-a9a3-348c9fc190d5', 'a0d2c401-0633-42bc-bd1d-b8c04bf795b0'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:29 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:29 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:29 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.info" returned: 0 in 0.278s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:29 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.info is being set with open permissions: ugo+rw Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:29 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.info Sep 15 19:07:29 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "cinder-45f8ae36-0ff6-4fe3-a021-e4e35d169353-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-45f8ae36-0ff6-4fe3-a021-e4e35d169353-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:29 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.304s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "cinder-quobyte-45f8ae36-0ff6-4fe3-a021-e4e35d169353" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Deleted volume successfully. Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-45f8ae36-0ff6-4fe3-a021-e4e35d169353" acquired by "delete_volume" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-e09c35f4-f477-4996-898a-c27e559ba53a tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-01dcc873-4b79-4efd-8265-3b4c0d82e289-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[effbd6fa-487b-454d-b787-a7d85252eecf]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:30 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.info" returned: 0 in 0.333s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:30 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 Sep 15 19:07:30 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.927s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-37289764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10752a06-f71b-46ba-985d-3e845b2d6f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cb4d6c50954b248f758c9b660a74d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:28Z,use_quota=True,user_id='1f4b6ec64b584af683348bfd2996aa04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Creating volume 10752a06-f71b-46ba-985d-3e845b2d6f1a {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:30 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:30 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a 1073741824 Sep 15 19:07:30 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:30 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0d1a901e-91e6-45b2-8c19-3318521edabe tempest-ProjectMemberTests-715700841 None] Create snapshot completed successfully Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-df421066-cd66-41f7-bae5-ba0ed36704d5-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Lock "cinder-df421066-cd66-41f7-bae5-ba0ed36704d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-df421066-cd66-41f7-bae5-ba0ed36704d5" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-df421066-cd66-41f7-bae5-ba0ed36704d5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Deleting offline snapshot df421066-cd66-41f7-bae5-ba0ed36704d5 of volume d7163859-6b48-4f05-89e1-fd9b0ddb7d19 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] snapshot_file for this snap is: volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0e2cd-373e-47d2-8c89-c6a0bda73c53]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:30 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353" returned: 0 in 0.397s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:30 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353 Sep 15 19:07:30 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:30 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 Sep 15 19:07:30 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:30 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a 1073741824" returned: 0 in 0.483s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:30 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-45f8ae36-0ff6-4fe3-a021-e4e35d169353" returned: 0 in 0.273s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:30 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a Sep 15 19:07:30 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-quobyte-45f8ae36-0ff6-4fe3-a021-e4e35d169353" released by "delete_volume" :: held 0.733s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Created reservations ['fe4cd96c-71dc-4df0-b55e-dafe7e8f98be', '60cb194b-d5e4-4056-8b1f-4583929ca445', 'cc14d5b1-1400-4bf4-9ce8-44b665dc98c8', '016e0936-4ea6-49bb-a9d4-ed0732912918'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:30 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5" returned: 0 in 0.435s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c649aed-c6ca-42f5-8e1d-beac3a8e514e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:30 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:30 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:30 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.528s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:30 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 Sep 15 19:07:30 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Creating offline snapshot 2599e643-3c47-4602-9e7d-c2c4e2cd402c of volume c3d9d542-6f5a-4783-87b0-00716ef983c0 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142058f8-5fcd-4b94-b655-9f09cc3750f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10752a06-f71b-46ba-985d-3e845b2d6f1a', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119ac3cd-0fee-4b1f-b7a3-a51592b6ba79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e402089-42d6-4736-8810-5691b8fa9e74]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:31 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Volume volume-10752a06-f71b-46ba-985d-3e845b2d6f1a (10752a06-f71b-46ba-985d-3e845b2d6f1a): created successfully Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119ac3cd-0fee-4b1f-b7a3-a51592b6ba79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Flow 'volume_create_manager' (443970e9-309b-4f36-91ee-eca593360201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-83cac99c-90b7-4771-a066-e6b152ebe453 tempest-CinderUnicodeTest-1362066862 None] Created volume successfully. Sep 15 19:07:31 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 Sep 15 19:07:31 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:31 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.401s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:31 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Deleted volume successfully. Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-481bc6a6-3c18-4770-80ee-bb847231079c tempest-VolumeDependencyTests-1411314039 None] Lock "cinder-45f8ae36-0ff6-4fe3-a021-e4e35d169353-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:31 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" returned: 0 in 0.498s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:31 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 Sep 15 19:07:31 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:31 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0" returned: 0 in 0.582s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:31 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c 1G Sep 15 19:07:31 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:31 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5" returned: 0 in 0.458s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:31 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:31 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5 Sep 15 19:07:31 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:32 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c 1G" returned: 0 in 0.501s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:32 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19.df421066-cd66-41f7-bae5-ba0ed36704d5" returned: 0 in 0.314s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:32 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c Sep 15 19:07:32 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-df421066-cd66-41f7-bae5-ba0ed36704d5" released by "_delete_snapshot" :: held 1.837s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" released by "delete_snapshot" :: held 1.866s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Created reservations ['f4bc74c3-907c-4080-9277-6f627a7f8d6a', '5b401ffb-229a-440c-b711-d81b28567810', '0fde612f-2cdc-40be-a175-665f7c76cb8f', 'c2f48010-9df6-4225-81a2-f7436530b2b7'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:32 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Delete snapshot completed successfully. Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8f6fe8c8-01ac-4b96-83ea-1b53ab897b06 tempest-ProjectMemberTests-715700841 None] Lock "cinder-df421066-cd66-41f7-bae5-ba0ed36704d5-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:32 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c" returned: 0 in 0.349s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:32 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c is being set with open permissions: ugo+rw Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:32 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c Sep 15 19:07:32 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-d7163859-6b48-4f05-89e1-fd9b0ddb7d19-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Lock "cinder-d7163859-6b48-4f05-89e1-fd9b0ddb7d19-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" acquired by "delete_volume" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f76a94-b03d-44e5-b1fd-f6d293bf157c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:32 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c" returned: 0 in 0.327s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:32 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 Sep 15 19:07:32 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:32 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.info Sep 15 19:07:32 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:33 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.info" returned: 0 in 0.295s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:33 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.info is being set with open permissions: ugo+rw Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:33 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" returned: 0 in 0.466s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:33 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.info Sep 15 19:07:33 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:33 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19 Sep 15 19:07:33 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:33 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.info" returned: 0 in 0.261s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:33 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.788s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" returned: 0 in 0.274s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Creating offline snapshot b6266f6f-9810-4ff7-8f33-2372489e8676 of volume 10752a06-f71b-46ba-985d-3e845b2d6f1a {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-d7163859-6b48-4f05-89e1-fd9b0ddb7d19" released by "delete_volume" :: held 0.847s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc9963e-c716-4327-9bb2-8c0a388866c1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:33 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-bb40d127-8d46-48e1-b80a-4a391f38dc14 tempest-ProjectReaderTests-1438187467 None] Create snapshot completed successfully Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Created reservations ['f1bfb168-49b3-4b0b-8a75-bfb8106ca8dd', '2d1534a7-449f-47f1-afbf-5dece220feb0', 'a1ad6a1a-53c9-4306-b68e-a0dff9cb85db', 'df11f1b0-eb18-42c6-903f-0e825e004e92'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:33 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a Sep 15 19:07:33 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:33 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:33 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-2599e643-3c47-4602-9e7d-c2c4e2cd402c-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Lock "cinder-2599e643-3c47-4602-9e7d-c2c4e2cd402c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-c3d9d542-6f5a-4783-87b0-00716ef983c0" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-c3d9d542-6f5a-4783-87b0-00716ef983c0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-2599e643-3c47-4602-9e7d-c2c4e2cd402c" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-2599e643-3c47-4602-9e7d-c2c4e2cd402c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Deleting offline snapshot 2599e643-3c47-4602-9e7d-c2c4e2cd402c of volume c3d9d542-6f5a-4783-87b0-00716ef983c0 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] snapshot_file for this snap is: volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e47f2a-8435-4c24-853e-8ed37d270237]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:33 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a" returned: 0 in 0.500s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:33 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c Sep 15 19:07:33 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:33 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 1G Sep 15 19:07:33 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:34 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.390s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:34 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Deleted volume successfully. Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a465845e-cef3-4a06-9b3f-dd498db03d71 tempest-ProjectMemberTests-715700841 None] Lock "cinder-d7163859-6b48-4f05-89e1-fd9b0ddb7d19-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:34 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c" returned: 0 in 0.529s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3d9d542-6f5a-4783-87b0-00716ef983c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c48d57-7872-4884-8d26-233bd194af57]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:34 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (adb1c668-6b3e-4ef8-9ea2-6449644548af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5920bffe-ba7b-4220-b63e-f0118c089d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 1G" returned: 0 in 0.558s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10752a06-f71b-46ba-985d-3e845b2d6f1a -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:34 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10752a06-f71b-46ba-985d-3e845b2d6f1a -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5920bffe-ba7b-4220-b63e-f0118c089d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451873034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe95d672-152f-4c76-948b-d0c731b550e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:34Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:34 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:34 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 Sep 15 19:07:34 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bffb3f4-aa3b-4a87-b258-63abb6e5305b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bffb3f4-aa3b-4a87-b258-63abb6e5305b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3da76f0-9f0e-44a8-af0c-94dc0d3b563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3da76f0-9f0e-44a8-af0c-94dc0d3b563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe95d672-152f-4c76-948b-d0c731b550e6', 'volume_name': 'volume-fe95d672-152f-4c76-948b-d0c731b550e6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d3e94f-b14e-4e9c-b2eb-8d4e3cd6e327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d3e94f-b14e-4e9c-b2eb-8d4e3cd6e327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38476af-b731-456f-b521-c4d3fb99159f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:34 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Volume fe95d672-152f-4c76-948b-d0c731b550e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe95d672-152f-4c76-948b-d0c731b550e6', 'volume_size': 1} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:34 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0" returned: 0 in 0.453s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:34 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10752a06-f71b-46ba-985d-3e845b2d6f1a -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676" returned: 0 in 0.353s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:34 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 is being set with open permissions: ugo+rw Sep 15 19:07:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:34 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c Sep 15 19:07:34 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:34 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 Sep 15 19:07:34 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:35 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676" returned: 0 in 0.254s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:35 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.info Sep 15 19:07:35 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:35 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c" returned: 0 in 0.389s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:35 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c Sep 15 19:07:35 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:35 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.info" returned: 0 in 0.283s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:35 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.info is being set with open permissions: ugo+rw Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:35 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.info Sep 15 19:07:35 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:35 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0.2599e643-3c47-4602-9e7d-c2c4e2cd402c" returned: 0 in 0.271s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-2599e643-3c47-4602-9e7d-c2c4e2cd402c" released by "_delete_snapshot" :: held 1.775s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-c3d9d542-6f5a-4783-87b0-00716ef983c0" released by "delete_snapshot" :: held 1.813s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Created reservations ['8f7673bd-8a97-4edf-a2cf-fa0bbf66c3e3', '10783a29-740d-496d-8667-ac60085310be', '890fa48a-e5eb-4312-8db3-3e14a1b211bc', 'c3e40b40-7266-47d6-b567-0a3537e2301b'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:35 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Delete snapshot completed successfully. Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8feaaab6-e736-4544-8374-9a00b2a3a0ad tempest-ProjectReaderTests-1438187467 None] Lock "cinder-2599e643-3c47-4602-9e7d-c2c4e2cd402c-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:35 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.info" returned: 0 in 0.284s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.170s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451873034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe95d672-152f-4c76-948b-d0c731b550e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:34Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Creating volume fe95d672-152f-4c76-948b-d0c731b550e6 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:35 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:35 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 1073741824 Sep 15 19:07:35 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:35 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1b2eaf8f-f1ea-477f-b577-a4469e2d78f5 tempest-CinderUnicodeTest-1362066862 None] Create snapshot completed successfully Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-c3d9d542-6f5a-4783-87b0-00716ef983c0-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-c3d9d542-6f5a-4783-87b0-00716ef983c0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "cinder-quobyte-c3d9d542-6f5a-4783-87b0-00716ef983c0" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-c3d9d542-6f5a-4783-87b0-00716ef983c0" acquired by "delete_volume" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[810c09c1-cb82-487f-b8c7-7dc055168ee1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:36 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 Sep 15 19:07:36 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:36 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 1073741824" returned: 0 in 0.588s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:36 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 Sep 15 19:07:36 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:36 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0" returned: 0 in 0.481s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:36 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0 Sep 15 19:07:36 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:36 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6" returned: 0 in 0.298s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38476af-b731-456f-b521-c4d3fb99159f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe95d672-152f-4c76-948b-d0c731b550e6', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc6e1c4-9177-44b8-a0f1-60a971e1a21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:36 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Volume volume-fe95d672-152f-4c76-948b-d0c731b550e6 (fe95d672-152f-4c76-948b-d0c731b550e6): created successfully Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc6e1c4-9177-44b8-a0f1-60a971e1a21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (adb1c668-6b3e-4ef8-9ea2-6449644548af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:36 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-26268643-27ec-4372-82aa-e2b6776a955a tempest-ProjectMemberTests-715700841 None] Created volume successfully. Sep 15 19:07:36 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-c3d9d542-6f5a-4783-87b0-00716ef983c0" returned: 0 in 0.288s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "cinder-b6266f6f-9810-4ff7-8f33-2372489e8676-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-quobyte-c3d9d542-6f5a-4783-87b0-00716ef983c0" released by "delete_volume" :: held 0.864s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-b6266f6f-9810-4ff7-8f33-2372489e8676-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "cinder-quobyte-10752a06-f71b-46ba-985d-3e845b2d6f1a" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-quobyte-10752a06-f71b-46ba-985d-3e845b2d6f1a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "cinder-quobyte-b6266f6f-9810-4ff7-8f33-2372489e8676" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-quobyte-b6266f6f-9810-4ff7-8f33-2372489e8676" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Deleting offline snapshot b6266f6f-9810-4ff7-8f33-2372489e8676 of volume 10752a06-f71b-46ba-985d-3e845b2d6f1a {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] snapshot_file for this snap is: volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65bb573-c01c-4ff3-97d1-9f4ebe30bdfd]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Created reservations ['710f64c5-6e41-4fa9-b964-21b946b0b0a1', '5527049b-550a-481c-9cc9-13e8c85b0de8', '3a691ce1-3aaa-41c5-9eca-4715196d82a7', '3f803b38-ea4c-4272-8f93-66fd175b5758'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:37 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 Sep 15 19:07:37 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:37 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:37 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:37 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.276s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Deleted volume successfully. Sep 15 19:07:37 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9eae759c-e566-4c29-8b31-d7f4a7c89d08 tempest-ProjectReaderTests-1438187467 None] Lock "cinder-c3d9d542-6f5a-4783-87b0-00716ef983c0-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676" returned: 0 in 0.443s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10752a06-f71b-46ba-985d-3e845b2d6f1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c47be6-19e5-4e0f-841b-db903e44b101]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:37 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a Sep 15 19:07:37 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Creating offline snapshot 3c1110aa-9f99-4a05-bd60-490fc055f5f0 of volume fe95d672-152f-4c76-948b-d0c731b550e6 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f23112a-cb6b-4718-a803-03e952c65723]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:37 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a" returned: 0 in 0.401s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:37 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 Sep 15 19:07:37 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:37 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 Sep 15 19:07:37 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:38 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6" returned: 0 in 0.424s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:38 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676" returned: 0 in 0.417s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:38 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 1G Sep 15 19:07:38 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:38 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676 Sep 15 19:07:38 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:38 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a.b6266f6f-9810-4ff7-8f33-2372489e8676" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-quobyte-b6266f6f-9810-4ff7-8f33-2372489e8676" released by "_delete_snapshot" :: held 1.746s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-quobyte-10752a06-f71b-46ba-985d-3e845b2d6f1a" released by "delete_snapshot" :: held 1.774s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:38 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 1G" returned: 0 in 0.562s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe95d672-152f-4c76-948b-d0c731b550e6 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:38 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Created reservations ['6077e7d9-83fc-4390-9f0d-9cac7ed83274', '2e499ee1-1e70-4b13-85bf-7eb2dc464f50', 'e7286ac3-db3d-4573-9e18-086e68c3afba', 'e0990aee-7b5d-4440-9c80-9479e5915dff'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:38 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe95d672-152f-4c76-948b-d0c731b550e6 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 Sep 15 19:07:38 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Delete snapshot completed successfully. Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a49e1cfb-72ef-44b6-8b93-42614e2a5f5a tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-b6266f6f-9810-4ff7-8f33-2372489e8676-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "cinder-10752a06-f71b-46ba-985d-3e845b2d6f1a-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-10752a06-f71b-46ba-985d-3e845b2d6f1a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "cinder-quobyte-10752a06-f71b-46ba-985d-3e845b2d6f1a" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-quobyte-10752a06-f71b-46ba-985d-3e845b2d6f1a" acquired by "delete_volume" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[65605176-6652-4f24-80b4-fb7fd7b02cd1]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:39 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe95d672-152f-4c76-948b-d0c731b550e6 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0" returned: 0 in 0.435s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:39 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 is being set with open permissions: ugo+rw Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:39 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 Sep 15 19:07:39 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:39 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a Sep 15 19:07:39 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:39 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0" returned: 0 in 0.292s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:39 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.info Sep 15 19:07:39 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:39 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a" returned: 0 in 0.490s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:39 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a Sep 15 19:07:39 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:39 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.info" returned: 0 in 0.329s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:39 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.info is being set with open permissions: ugo+rw Sep 15 19:07:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:39 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.info Sep 15 19:07:39 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:40 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-10752a06-f71b-46ba-985d-3e845b2d6f1a" returned: 0 in 0.399s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-quobyte-10752a06-f71b-46ba-985d-3e845b2d6f1a" released by "delete_volume" :: held 0.976s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Created reservations ['39481a5b-5228-4c15-86c1-8c56d23e29b1', '21b76ae2-3185-43b5-8e99-9864046a749f', '8df90833-7aee-4c9e-a0ce-5ba0958bca24', 'aa35a3fe-cf02-4ce3-87a0-1dd6b65d0829'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:40 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.info" returned: 0 in 0.320s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1b9f2eea-ed1d-46e1-887b-a70600e8b432 tempest-ProjectMemberTests-715700841 None] Create snapshot completed successfully Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:40 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:40 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:40 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.275s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Deleted volume successfully. Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6a9d6f1b-5b38-4c72-9e9b-6fc26ba268b1 tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-10752a06-f71b-46ba-985d-3e845b2d6f1a-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:40 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-3c1110aa-9f99-4a05-bd60-490fc055f5f0-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Lock "cinder-3c1110aa-9f99-4a05-bd60-490fc055f5f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-fe95d672-152f-4c76-948b-d0c731b550e6" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-fe95d672-152f-4c76-948b-d0c731b550e6" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-3c1110aa-9f99-4a05-bd60-490fc055f5f0" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-3c1110aa-9f99-4a05-bd60-490fc055f5f0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Deleting offline snapshot 3c1110aa-9f99-4a05-bd60-490fc055f5f0 of volume fe95d672-152f-4c76-948b-d0c731b550e6 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] snapshot_file for this snap is: volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9ad6fc-9865-4d00-8358-5afa5bafabf0]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:41 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 Sep 15 19:07:41 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "cinder-3b7af763-f248-4a73-a062-757829a8e856-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-3b7af763-f248-4a73-a062-757829a8e856-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "cinder-quobyte-3b7af763-f248-4a73-a062-757829a8e856" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-quobyte-3b7af763-f248-4a73-a062-757829a8e856" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c77a45-81c9-4564-8840-f59277fb2b37]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:41 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0" returned: 0 in 0.431s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe95d672-152f-4c76-948b-d0c731b550e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f37b9f-6237-4d29-b179-9281ca478de2]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:41 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856 Sep 15 19:07:41 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:41 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 Sep 15 19:07:41 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:41 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856" returned: 0 in 0.395s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:41 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:41 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856 Sep 15 19:07:41 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:42 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6" returned: 0 in 0.414s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:42 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 Sep 15 19:07:42 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:42 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3b7af763-f248-4a73-a062-757829a8e856" returned: 0 in 0.418s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-quobyte-3b7af763-f248-4a73-a062-757829a8e856" released by "delete_volume" :: held 0.866s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Created reservations ['f83a3258-e29b-46f9-83d2-03f7bc1108ea', 'c9b435c2-5b57-4918-98bd-e6bfea8bb90a', '7ad23d97-a12c-4139-beeb-cdb0ef3a651d', '84814686-343d-47b9-80f4-b671dabf29e6'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:42 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0" returned: 0 in 0.474s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:42 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0 Sep 15 19:07:42 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:42 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:42 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:42 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6.3c1110aa-9f99-4a05-bd60-490fc055f5f0" returned: 0 in 0.424s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:42 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.414s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:42 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-3c1110aa-9f99-4a05-bd60-490fc055f5f0" released by "_delete_snapshot" :: held 1.909s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:43 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Deleted volume successfully. Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-fe95d672-152f-4c76-948b-d0c731b550e6" released by "delete_snapshot" :: held 1.945s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0a31f3aa-e3dc-4206-9ece-13f35899c6da tempest-CinderUnicodeTest-1362066862 None] Lock "cinder-3b7af763-f248-4a73-a062-757829a8e856-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Created reservations ['c7c6dd11-6118-4a4d-bd3f-839b7352ce88', 'f67e2b46-509b-4444-bd11-75b06d52bd96', '2d441e45-32e4-4940-be8e-fc81319b9708', '13235931-16e2-42d3-a249-497108793c28'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:43 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Delete snapshot completed successfully. Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9ab82e41-4c28-4ab7-8aac-d893eafc4bf7 tempest-ProjectMemberTests-715700841 None] Lock "cinder-3c1110aa-9f99-4a05-bd60-490fc055f5f0-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-fe95d672-152f-4c76-948b-d0c731b550e6-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Lock "cinder-fe95d672-152f-4c76-948b-d0c731b550e6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-fe95d672-152f-4c76-948b-d0c731b550e6" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-fe95d672-152f-4c76-948b-d0c731b550e6" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12b19d3-d73f-4f47-8fc6-af6c03effb9e]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:43 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 Sep 15 19:07:43 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:43 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6" returned: 0 in 0.481s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:43 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6 Sep 15 19:07:43 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:44 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-fe95d672-152f-4c76-948b-d0c731b550e6" returned: 0 in 0.297s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-fe95d672-152f-4c76-948b-d0c731b550e6" released by "delete_volume" :: held 0.896s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Created reservations ['a0ca4991-6d43-41a4-9602-b0b172549f15', '17993dd1-1a1b-4eed-aef4-4e497eab19e7', '19b95c26-aae8-44e1-8835-6056b60258c4', '51a6dee9-01d0-4932-8b2d-b261bc03d3bb'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:44 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:44 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:44 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.324s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:44 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Deleted volume successfully. Sep 15 19:07:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9edaa3a9-160f-4459-a1d1-7116dcbf562c tempest-ProjectMemberTests-715700841 None] Lock "cinder-fe95d672-152f-4c76-948b-d0c731b550e6-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (0a1f5355-92fe-46e8-8fd5-628d0165dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf825af0-5b5d-4ade-8667-3294f359d751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf825af0-5b5d-4ade-8667-3294f359d751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375801102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ccb4ae-481f-4af6-9336-b8f9c711fdb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:45Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7a115a-2785-4e77-9d27-48d3dd70c17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e7a115a-2785-4e77-9d27-48d3dd70c17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f45ede9-72b0-46a6-b3a7-450a857cd719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f45ede9-72b0-46a6-b3a7-450a857cd719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ccb4ae-481f-4af6-9336-b8f9c711fdb2', 'volume_name': 'volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761f0b67-0fac-4c7e-9cf3-cb15807b4b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761f0b67-0fac-4c7e-9cf3-cb15807b4b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fb3c06-9f2a-49b3-89ee-0b64d96b4dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:45 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Volume 09ccb4ae-481f-4af6-9336-b8f9c711fdb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2', 'volume_size': 1} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375801102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ccb4ae-481f-4af6-9336-b8f9c711fdb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:45Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Creating volume 09ccb4ae-481f-4af6-9336-b8f9c711fdb2 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:45 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:45 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 1073741824 Sep 15 19:07:45 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:45 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 1073741824" returned: 0 in 0.565s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:45 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:45 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:45 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 Sep 15 19:07:45 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:46 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" returned: 0 in 0.381s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fb3c06-9f2a-49b3-89ee-0b64d96b4dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91971bc-88b0-472e-811e-57bdd9282a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:46 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.499s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:46 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Volume volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 (09ccb4ae-481f-4af6-9336-b8f9c711fdb2): created successfully Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91971bc-88b0-472e-811e-57bdd9282a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (0a1f5355-92fe-46e8-8fd5-628d0165dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 19:07:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 19:07:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-60a9f3b8-31f5-47c3-8789-0b10339670cf tempest-ProjectMemberTests-715700841 None] Created volume successfully. Sep 15 19:07:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:47 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Creating offline snapshot 91429c15-e260-4bb2-9f7a-646bd6065543 of volume 09ccb4ae-481f-4af6-9336-b8f9c711fdb2 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:07:47 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94e0eb4-2a4f-47e2-a709-84344acda2f9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:47 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 Sep 15 19:07:47 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:47 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" returned: 0 in 0.411s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:47 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 1G Sep 15 19:07:47 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:48 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 1G" returned: 0 in 0.545s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:48 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 Sep 15 19:07:48 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:48 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543" returned: 0 in 0.395s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:48 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 is being set with open permissions: ugo+rw Sep 15 19:07:48 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:48 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 Sep 15 19:07:48 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:49 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543" returned: 0 in 0.309s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:49 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.info Sep 15 19:07:49 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:49 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.info" returned: 0 in 0.343s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:49 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.info is being set with open permissions: ugo+rw Sep 15 19:07:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:49 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.info Sep 15 19:07:49 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:49 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.info" returned: 0 in 0.344s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:49 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:49 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dbfcd235-dc8e-403d-a962-897f027435bf tempest-ProjectMemberTests-715700841 None] Create snapshot completed successfully Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-91429c15-e260-4bb2-9f7a-646bd6065543-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Lock "cinder-91429c15-e260-4bb2-9f7a-646bd6065543-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-91429c15-e260-4bb2-9f7a-646bd6065543" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-91429c15-e260-4bb2-9f7a-646bd6065543" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Deleting offline snapshot 91429c15-e260-4bb2-9f7a-646bd6065543 of volume 09ccb4ae-481f-4af6-9336-b8f9c711fdb2 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] snapshot_file for this snap is: volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e77908-55ab-4abc-a60f-e61719d063c3]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:50 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:50 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 Sep 15 19:07:50 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:51 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543" returned: 0 in 0.483s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:51 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a75aba2-b1ea-4b39-986d-5ef5a4ac3985]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:51 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 Sep 15 19:07:51 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:51 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" returned: 0 in 0.523s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:51 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 Sep 15 19:07:51 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:52 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543" returned: 0 in 0.451s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:52 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543 Sep 15 19:07:52 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:52 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2.91429c15-e260-4bb2-9f7a-646bd6065543" returned: 0 in 0.306s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-91429c15-e260-4bb2-9f7a-646bd6065543" released by "_delete_snapshot" :: held 1.925s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" released by "delete_snapshot" :: held 1.955s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:52 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Created reservations ['757bffcc-5bff-4621-979a-403472688576', '62353dba-42d8-4e7f-a5ba-676f896f65c3', '49a6f355-eb1d-49a2-a322-60184c5cd47f', '8faa44f6-fbfa-45cf-bf22-667280b0b926'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Delete snapshot completed successfully. Sep 15 19:07:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-8e9d3924-85bb-4ad8-bb48-18ed9dfd5172 tempest-ProjectMemberTests-715700841 None] Lock "cinder-91429c15-e260-4bb2-9f7a-646bd6065543-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-09ccb4ae-481f-4af6-9336-b8f9c711fdb2-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Lock "cinder-09ccb4ae-481f-4af6-9336-b8f9c711fdb2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[049af615-e3f2-4349-99a5-8ad507c44b72]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:53 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 Sep 15 19:07:53 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:53 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" returned: 0 in 0.491s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:53 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2 Sep 15 19:07:53 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:53 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" returned: 0 in 0.289s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-09ccb4ae-481f-4af6-9336-b8f9c711fdb2" released by "delete_volume" :: held 0.874s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:53 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Created reservations ['e0f911ce-25e8-4bda-ac55-211693c69663', '31725e8e-d1b3-463e-bae9-ecfd1f22d63a', 'f5829e4c-e59d-45a9-a4b9-08f7725b7038', '929e944d-a8b0-49b9-96ef-c36ea726cbf0'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:54 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:07:54 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:54 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.319s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:07:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Deleted volume successfully. Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-89976860-9237-461c-95de-414e6ac6d80a tempest-ProjectMemberTests-715700841 None] Lock "cinder-09ccb4ae-481f-4af6-9336-b8f9c711fdb2-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (1c37d3e0-f33e-496f-bcb7-93a2d55d2078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c419e9f-38c5-45b5-8a72-ae271fd6be7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c419e9f-38c5-45b5-8a72-ae271fd6be7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558142446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f18b29-232a-43e2-b63d-2678e2914473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:55Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d26dba2-0b5c-4c93-b155-98568312856a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d26dba2-0b5c-4c93-b155-98568312856a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a311587c-1d1e-438e-8d13-2f6a2800e0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a311587c-1d1e-438e-8d13-2f6a2800e0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f18b29-232a-43e2-b63d-2678e2914473', 'volume_name': 'volume-83f18b29-232a-43e2-b63d-2678e2914473', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a9fefa-4e54-4562-a388-d95fa0d0452c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45a9fefa-4e54-4562-a388-d95fa0d0452c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124f4411-b554-4aaa-873e-4c240378fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:54 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Volume 83f18b29-232a-43e2-b63d-2678e2914473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f18b29-232a-43e2-b63d-2678e2914473', 'volume_size': 1} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1558142446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f18b29-232a-43e2-b63d-2678e2914473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:55Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Creating volume 83f18b29-232a-43e2-b63d-2678e2914473 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:54 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:54 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 1073741824 Sep 15 19:07:54 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:55 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 1073741824" returned: 0 in 0.506s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:55 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 Sep 15 19:07:55 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:55 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473" returned: 0 in 0.295s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124f4411-b554-4aaa-873e-4c240378fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f18b29-232a-43e2-b63d-2678e2914473', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6287bf40-232e-4bbb-94a6-ad3a7949357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:55 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Volume volume-83f18b29-232a-43e2-b63d-2678e2914473 (83f18b29-232a-43e2-b63d-2678e2914473): created successfully Sep 15 19:07:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6287bf40-232e-4bbb-94a6-ad3a7949357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:55 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (1c37d3e0-f33e-496f-bcb7-93a2d55d2078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c7e210f4-9ebe-4fcd-934c-fbe3a6042aab tempest-ProjectMemberTests-715700841 None] Created volume successfully. Sep 15 19:07:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Creating offline snapshot 40cd7451-0064-47df-a8a5-4faed7f7f046 of volume 83f18b29-232a-43e2-b63d-2678e2914473 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2096035b-4a95-4671-8693-535f30426c99]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:57 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 Sep 15 19:07:57 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Flow 'volume_create_manager' (54e9625b-fe91-43d7-9d03-e18795c8965f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10524a3-2548-4f8a-9e16-3237cf604305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:57 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473" returned: 0 in 0.377s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10524a3-2548-4f8a-9e16-3237cf604305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476047029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4d9595-c4a2-436e-80a9-8aeca0748e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ee8bcf2a44fb8bfc0db04430700a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:57Z,use_quota=True,user_id='1997fea2398c4cc8998b10356e15570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b565172-3c30-455d-b726-40c0bfc1e886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:57 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 1G Sep 15 19:07:57 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b565172-3c30-455d-b726-40c0bfc1e886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6009c80-0e41-403c-a491-0c62ac114d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6009c80-0e41-403c-a491-0c62ac114d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c4d9595-c4a2-436e-80a9-8aeca0748e1c', 'volume_name': 'volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60df59c-cf34-42cc-9242-90def56218a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60df59c-cf34-42cc-9242-90def56218a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd609bec-cbf7-4ba5-8ff7-6463f9ec8a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:57 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Volume 9c4d9595-c4a2-436e-80a9-8aeca0748e1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c', 'volume_size': 1} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:57 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 1G" returned: 0 in 0.403s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:57 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f18b29-232a-43e2-b63d-2678e2914473 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:57 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f18b29-232a-43e2-b63d-2678e2914473 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 Sep 15 19:07:57 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:58 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83f18b29-232a-43e2-b63d-2678e2914473 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046" returned: 0 in 0.284s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:58 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 is being set with open permissions: ugo+rw Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:58 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 Sep 15 19:07:58 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:58 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046" returned: 0 in 0.240s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:58 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.info Sep 15 19:07:58 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:58 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.info" returned: 0 in 0.249s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:58 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.info is being set with open permissions: ugo+rw Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:58 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.info Sep 15 19:07:58 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:58 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.info" returned: 0 in 0.235s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.383s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-476047029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4d9595-c4a2-436e-80a9-8aeca0748e1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ee8bcf2a44fb8bfc0db04430700a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:07:57Z,use_quota=True,user_id='1997fea2398c4cc8998b10356e15570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Creating volume 9c4d9595-c4a2-436e-80a9-8aeca0748e1c {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:07:58 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:07:58 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:58 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c 1073741824 Sep 15 19:07:58 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:58 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a3ef53f7-0330-480c-a0ee-c9cc4c01efe9 tempest-ProjectMemberTests-715700841 None] Create snapshot completed successfully Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-40cd7451-0064-47df-a8a5-4faed7f7f046-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Lock "cinder-40cd7451-0064-47df-a8a5-4faed7f7f046-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-83f18b29-232a-43e2-b63d-2678e2914473" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-83f18b29-232a-43e2-b63d-2678e2914473" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-40cd7451-0064-47df-a8a5-4faed7f7f046" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-40cd7451-0064-47df-a8a5-4faed7f7f046" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Deleting offline snapshot 40cd7451-0064-47df-a8a5-4faed7f7f046 of volume 83f18b29-232a-43e2-b63d-2678e2914473 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] snapshot_file for this snap is: volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4bcfd7-44b6-4eb5-b058-7a347a59a844]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:59 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c 1073741824" returned: 0 in 0.456s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:59 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 Sep 15 19:07:59 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:59 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c Sep 15 19:07:59 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:07:59 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046" returned: 0 in 0.374s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83f18b29-232a-43e2-b63d-2678e2914473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:07:59 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[e376c78d-2813-4db4-9d1b-abbe7c62d161]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd609bec-cbf7-4ba5-8ff7-6463f9ec8a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c0f986-26cc-494e-b9e5-9f7d728da47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:07:59 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Volume volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c (9c4d9595-c4a2-436e-80a9-8aeca0748e1c): created successfully Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c0f986-26cc-494e-b9e5-9f7d728da47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:07:59 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Flow 'volume_create_manager' (54e9625b-fe91-43d7-9d03-e18795c8965f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:07:59 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-629ad1f3-7735-43fd-8bac-1472916b7bec tempest-ProjectReaderTests-1968210312 None] Created volume successfully. Sep 15 19:07:59 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 Sep 15 19:07:59 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:00 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473" returned: 0 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:00 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 Sep 15 19:08:00 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:00 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046" returned: 0 in 0.315s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:00 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046 Sep 15 19:08:00 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:00 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473.40cd7451-0064-47df-a8a5-4faed7f7f046" returned: 0 in 0.257s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-40cd7451-0064-47df-a8a5-4faed7f7f046" released by "_delete_snapshot" :: held 1.429s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-83f18b29-232a-43e2-b63d-2678e2914473" released by "delete_snapshot" :: held 1.453s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Acquiring lock "cinder-9c4d9595-c4a2-436e-80a9-8aeca0748e1c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Lock "cinder-9c4d9595-c4a2-436e-80a9-8aeca0748e1c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Created reservations ['2434a687-1bb1-40ab-9306-a3be57074433', '13db6dfd-5765-4d2d-b62d-3af2fe69661e', 'bed50078-1b0f-4333-b33b-d10d3a0ea893', '4da9e98e-24b8-422b-883d-c0ea3031164c'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Acquiring lock "cinder-quobyte-9c4d9595-c4a2-436e-80a9-8aeca0748e1c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Lock "cinder-quobyte-9c4d9595-c4a2-436e-80a9-8aeca0748e1c" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1cbb9f-723d-4e35-95e7-590b5ae317d9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:00 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Delete snapshot completed successfully. Sep 15 19:08:00 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-22b99944-b27b-4e92-868e-8ab681cdfaf3 tempest-ProjectMemberTests-715700841 None] Lock "cinder-40cd7451-0064-47df-a8a5-4faed7f7f046-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:00 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c Sep 15 19:08:00 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:01 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c" returned: 0 in 0.357s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:01 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c Sep 15 19:08:01 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-83f18b29-232a-43e2-b63d-2678e2914473-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Lock "cinder-83f18b29-232a-43e2-b63d-2678e2914473-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-83f18b29-232a-43e2-b63d-2678e2914473" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-83f18b29-232a-43e2-b63d-2678e2914473" acquired by "delete_volume" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:01 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[becd6b3f-601f-45a7-9e30-32af7af3edb7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c4d9595-c4a2-436e-80a9-8aeca0748e1c" returned: 0 in 0.271s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Lock "cinder-quobyte-9c4d9595-c4a2-436e-80a9-8aeca0748e1c" released by "delete_volume" :: held 0.679s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Created reservations ['7fbf8933-e521-4665-a349-7bcd1d694641', 'd3362c3d-183a-4c0b-9f4a-478ef777c60d', '452c5994-086f-42c7-9c60-65a63f97817f', '03d4a517-854e-4618-b579-830a29be3076'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:01 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 Sep 15 19:08:01 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:01 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:01 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:01 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473" returned: 0 in 0.393s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:01 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.270s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:01 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473 Sep 15 19:08:01 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:01 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Deleted volume successfully. Sep 15 19:08:01 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3fe19d06-7343-42e4-a7ee-422c625e3e2a tempest-ProjectReaderTests-1968210312 None] Lock "cinder-9c4d9595-c4a2-436e-80a9-8aeca0748e1c-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:02 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-83f18b29-232a-43e2-b63d-2678e2914473" returned: 0 in 0.251s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-83f18b29-232a-43e2-b63d-2678e2914473" released by "delete_volume" :: held 0.720s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Created reservations ['95bd007b-501e-4398-9d35-050c26d047a8', 'ed14a21b-55b7-48d4-a189-6ef7f16a7c25', 'ca464999-7cc2-4132-b52d-ebc01dcb00dd', '514e4f53-169e-481a-9125-040b3754a448'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:02 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:02 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Flow 'volume_create_manager' (983d6ec3-6daf-40a2-ba31-0bd6353953a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1218c404-d160-4a14-a8bb-a607eb223b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1218c404-d160-4a14-a8bb-a607eb223b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789511735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b233ac-510e-4a8d-89b8-cb921fc14fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ee8bcf2a44fb8bfc0db04430700a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:02Z,use_quota=True,user_id='1997fea2398c4cc8998b10356e15570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78230b5e-f353-480b-8b67-0a5d6a688067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78230b5e-f353-480b-8b67-0a5d6a688067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8624a005-492b-49a3-9502-18ef722bf679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8624a005-492b-49a3-9502-18ef722bf679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b233ac-510e-4a8d-89b8-cb921fc14fd1', 'volume_name': 'volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2cb813-dfd1-4e31-b1c4-af768378e9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2cb813-dfd1-4e31-b1c4-af768378e9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c9de8-d206-42a8-b563-5f5d8d4a43f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:02 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Volume 74b233ac-510e-4a8d-89b8-cb921fc14fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1', 'volume_size': 1} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-789511735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b233ac-510e-4a8d-89b8-cb921fc14fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ee8bcf2a44fb8bfc0db04430700a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:02Z,use_quota=True,user_id='1997fea2398c4cc8998b10356e15570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Creating volume 74b233ac-510e-4a8d-89b8-cb921fc14fd1 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:02 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:02 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 1073741824 Sep 15 19:08:02 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:02 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.271s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:02 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Deleted volume successfully. Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-dfd7560e-e47c-40c3-be81-1900bfa80ab9 tempest-ProjectMemberTests-715700841 None] Lock "cinder-83f18b29-232a-43e2-b63d-2678e2914473-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:02 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 1073741824" returned: 0 in 0.504s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (5252de60-27e9-4a48-89c5-cde0f8c92699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd210254-44cf-4f82-9794-5f8f664630cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd210254-44cf-4f82-9794-5f8f664630cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919868078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767616fb-e71b-4c3b-aac2-7cc4c3523ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:03Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa253163-d5c9-4093-a872-6f852076b639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa253163-d5c9-4093-a872-6f852076b639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a2a921-8f28-4810-aba5-afcca2b42af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:02 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a2a921-8f28-4810-aba5-afcca2b42af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767616fb-e71b-4c3b-aac2-7cc4c3523ab5', 'volume_name': 'volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b6cce4-c184-493f-b251-b61e2d382936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b6cce4-c184-493f-b251-b61e2d382936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5979851f-f01f-4ddb-8f29-67423ea84a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Volume 767616fb-e71b-4c3b-aac2-7cc4c3523ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5', 'volume_size': 1} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:03 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 Sep 15 19:08:03 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:03 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1" returned: 0 in 0.241s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919868078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767616fb-e71b-4c3b-aac2-7cc4c3523ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:03Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Creating volume 767616fb-e71b-4c3b-aac2-7cc4c3523ab5 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:03 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c9de8-d206-42a8-b563-5f5d8d4a43f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:03 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 1073741824 Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ab0cab-4985-4f74-b9c2-ebffcc47864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:03 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:03 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Volume volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 (74b233ac-510e-4a8d-89b8-cb921fc14fd1): created successfully Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ab0cab-4985-4f74-b9c2-ebffcc47864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Flow 'volume_create_manager' (983d6ec3-6daf-40a2-ba31-0bd6353953a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:03 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4ce2227a-475e-4982-af6c-84a0b54d9525 tempest-ProjectReaderTests-1968210312 None] Created volume successfully. Sep 15 19:08:03 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 1073741824" returned: 0 in 0.412s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:03 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 Sep 15 19:08:03 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:03 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" returned: 0 in 0.251s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5979851f-f01f-4ddb-8f29-67423ea84a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:03 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5e59b6-7340-4bd2-84fc-e4844c4c6c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:04 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Volume volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 (767616fb-e71b-4c3b-aac2-7cc4c3523ab5): created successfully Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5e59b6-7340-4bd2-84fc-e4844c4c6c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (5252de60-27e9-4a48-89c5-cde0f8c92699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:04 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-841e7902-e57e-45de-8a5f-ed05483355ac tempest-ProjectMemberTests-715700841 None] Created volume successfully. Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Acquiring lock "cinder-74b233ac-510e-4a8d-89b8-cb921fc14fd1-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Lock "cinder-74b233ac-510e-4a8d-89b8-cb921fc14fd1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Acquiring lock "cinder-quobyte-74b233ac-510e-4a8d-89b8-cb921fc14fd1" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Lock "cinder-quobyte-74b233ac-510e-4a8d-89b8-cb921fc14fd1" acquired by "delete_volume" :: waited 0.012s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0f5869-519a-4c5c-8574-b497ed5a93dd]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:04 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 Sep 15 19:08:04 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:04 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1" returned: 0 in 0.375s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:04 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:04 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1 Sep 15 19:08:04 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:05 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Creating offline snapshot 5dfda3a6-1eb0-42c6-8431-3885b000100d of volume 767616fb-e71b-4c3b-aac2-7cc4c3523ab5 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-74b233ac-510e-4a8d-89b8-cb921fc14fd1" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Lock "cinder-quobyte-74b233ac-510e-4a8d-89b8-cb921fc14fd1" released by "delete_volume" :: held 0.684s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afac766-ed7b-4cfb-b29a-89ab088455cc]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Created reservations ['6da27e9a-d284-4b9e-94fd-2c82414f74cd', '6dcec09b-176f-49a6-a692-8a47ec5dc2e4', 'a680ae94-ad06-4d96-afc6-075501201652', '2aaeda69-2c34-40bb-9791-27e46707a9fe'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:05 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 Sep 15 19:08:05 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:05 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:05 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:05 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" returned: 0 in 0.382s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:05 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:05 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Deleted volume successfully. Sep 15 19:08:05 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d 1G Sep 15 19:08:05 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:05 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0916f853-0019-488e-b8f9-f00528352efe tempest-ProjectReaderTests-1968210312 None] Lock "cinder-74b233ac-510e-4a8d-89b8-cb921fc14fd1-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:06 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Flow 'volume_create_manager' (f602a1d6-deeb-4aab-8636-af1c05342ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9b6539-65a6-4eba-9215-94107232d877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d 1G" returned: 0 in 0.476s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9b6539-65a6-4eba-9215-94107232d877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170928818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c058af-f1c2-4a0d-b7c7-683660fd2f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ee8bcf2a44fb8bfc0db04430700a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:06Z,use_quota=True,user_id='1997fea2398c4cc8998b10356e15570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:06 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d Sep 15 19:08:06 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc353b67-f209-491b-8e3e-5f87634dfe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc353b67-f209-491b-8e3e-5f87634dfe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a6eca1-33d4-4f80-88cc-39ec88312690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a6eca1-33d4-4f80-88cc-39ec88312690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c058af-f1c2-4a0d-b7c7-683660fd2f26', 'volume_name': 'volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a214b3a-15e7-498b-97ab-4c347dd0f7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a214b3a-15e7-498b-97ab-4c347dd0f7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46376b93-fd79-4aa1-a0ed-c21f57ab4225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:06 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Volume 71c058af-f1c2-4a0d-b7c7-683660fd2f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26', 'volume_size': 1} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:06 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d" returned: 0 in 0.284s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:06 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d is being set with open permissions: ugo+rw Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:06 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d Sep 15 19:08:06 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:06 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d" returned: 0 in 0.241s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:06 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.info Sep 15 19:08:06 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:06 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.info" returned: 0 in 0.243s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:06 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.info is being set with open permissions: ugo+rw Sep 15 19:08:06 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:06 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.info Sep 15 19:08:06 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:07 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.info" returned: 0 in 0.250s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-170928818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c058af-f1c2-4a0d-b7c7-683660fd2f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ee8bcf2a44fb8bfc0db04430700a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:06Z,use_quota=True,user_id='1997fea2398c4cc8998b10356e15570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Creating volume 71c058af-f1c2-4a0d-b7c7-683660fd2f26 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:07 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:07 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 1073741824 Sep 15 19:08:07 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-80e2b801-1256-43a4-a843-cd5b908f2c8b tempest-ProjectMemberTests-715700841 None] Create snapshot completed successfully Sep 15 19:08:07 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 1073741824" returned: 0 in 0.407s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:07 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 Sep 15 19:08:07 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:07 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26" returned: 0 in 0.249s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46376b93-fd79-4aa1-a0ed-c21f57ab4225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbdec82-12a7-4121-a1a8-00fe52775416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:07 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Volume volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 (71c058af-f1c2-4a0d-b7c7-683660fd2f26): created successfully Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbdec82-12a7-4121-a1a8-00fe52775416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:07 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Flow 'volume_create_manager' (f602a1d6-deeb-4aab-8636-af1c05342ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:07 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-dc5edfa8-390e-4b7b-9ed9-b5df581883fd tempest-ProjectReaderTests-1968210312 None] Created volume successfully. Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Acquiring lock "cinder-71c058af-f1c2-4a0d-b7c7-683660fd2f26-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Lock "cinder-71c058af-f1c2-4a0d-b7c7-683660fd2f26-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Acquiring lock "cinder-quobyte-71c058af-f1c2-4a0d-b7c7-683660fd2f26" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Lock "cinder-quobyte-71c058af-f1c2-4a0d-b7c7-683660fd2f26" acquired by "delete_volume" :: waited 0.013s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0748a8-86d5-48c8-903a-d5923f0323b4]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-5dfda3a6-1eb0-42c6-8431-3885b000100d-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Lock "cinder-5dfda3a6-1eb0-42c6-8431-3885b000100d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-5dfda3a6-1eb0-42c6-8431-3885b000100d" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-5dfda3a6-1eb0-42c6-8431-3885b000100d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Deleting offline snapshot 5dfda3a6-1eb0-42c6-8431-3885b000100d of volume 767616fb-e71b-4c3b-aac2-7cc4c3523ab5 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:08:08 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 Sep 15 19:08:08 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] snapshot_file for this snap is: volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[280082dd-2766-4bfb-8831-2cbd813371fa]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:08 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d Sep 15 19:08:08 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:08 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26" returned: 0 in 0.379s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:08 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26 Sep 15 19:08:08 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:08 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d" returned: 0 in 0.379s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ba5f5-86c2-4187-b143-53402c156846]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:08 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-71c058af-f1c2-4a0d-b7c7-683660fd2f26" returned: 0 in 0.256s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Lock "cinder-quobyte-71c058af-f1c2-4a0d-b7c7-683660fd2f26" released by "delete_volume" :: held 0.680s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:08 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 Sep 15 19:08:08 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Created reservations ['61e2d291-e0ea-495a-8e84-5a253acddd37', '491c35c5-13fa-4b6e-975b-a93f1979bce7', '656cb46a-065a-460c-bbf0-67ab08ad769c', 'c6eef57d-23d5-4a65-8869-2cc32ba3866f'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:08 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:09 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:09 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:09 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" returned: 0 in 0.358s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:09 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d Sep 15 19:08:09 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:09 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.267s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:09 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Deleted volume successfully. Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-70160fad-a9ad-43da-aba6-ec1250dc093d tempest-ProjectReaderTests-1968210312 None] Lock "cinder-71c058af-f1c2-4a0d-b7c7-683660fd2f26-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:09 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d" returned: 0 in 0.355s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:09 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d Sep 15 19:08:09 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:09 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Flow 'volume_create_manager' (dacdb883-7fb5-4743-aead-7402b8b95890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0afb5c9-ad85-4f6b-8ab7-76d0ef1b3e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5.5dfda3a6-1eb0-42c6-8431-3885b000100d" returned: 0 in 0.283s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0afb5c9-ad85-4f6b-8ab7-76d0ef1b3e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1265019807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f3dc74-5350-4581-8e73-d361ccc787dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ee8bcf2a44fb8bfc0db04430700a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:10Z,use_quota=True,user_id='1997fea2398c4cc8998b10356e15570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe74e054-affa-470b-a777-34d5afd12534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe74e054-affa-470b-a777-34d5afd12534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8921a8-47d3-44e3-aa20-e6778e7295e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8921a8-47d3-44e3-aa20-e6778e7295e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42f3dc74-5350-4581-8e73-d361ccc787dd', 'volume_name': 'volume-42f3dc74-5350-4581-8e73-d361ccc787dd', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a6456b-ebab-4814-a57e-6bc282a03b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a6456b-ebab-4814-a57e-6bc282a03b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29b6ce2-0115-4375-af8d-1d65af37378a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:09 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Volume 42f3dc74-5350-4581-8e73-d361ccc787dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42f3dc74-5350-4581-8e73-d361ccc787dd', 'volume_size': 1} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1265019807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f3dc74-5350-4581-8e73-d361ccc787dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ee8bcf2a44fb8bfc0db04430700a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:10Z,use_quota=True,user_id='1997fea2398c4cc8998b10356e15570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Creating volume 42f3dc74-5350-4581-8e73-d361ccc787dd {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:09 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-5dfda3a6-1eb0-42c6-8431-3885b000100d" released by "_delete_snapshot" :: held 1.540s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" released by "delete_snapshot" :: held 1.564s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:09 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd 1073741824 Sep 15 19:08:09 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:09 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Created reservations ['70f62ff0-cb2b-48a2-86f5-f94289b07820', '2b759eeb-098a-4ef3-b8ca-68c60e1333c4', 'ffd53a7a-035f-4fc7-a2aa-8dfc6d6e6939', 'ed917adf-7ed6-45e8-a050-c9bc6118fff2'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:09 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Delete snapshot completed successfully. Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b652b445-224b-470e-a4a2-a4c21115a3ce tempest-ProjectMemberTests-715700841 None] Lock "cinder-5dfda3a6-1eb0-42c6-8431-3885b000100d-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:10 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd 1073741824" returned: 0 in 0.429s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:10 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd Sep 15 19:08:10 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-767616fb-e71b-4c3b-aac2-7cc4c3523ab5-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Lock "cinder-767616fb-e71b-4c3b-aac2-7cc4c3523ab5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" acquired by "delete_volume" :: waited 0.025s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:10 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd" returned: 0 in 0.263s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29b6ce2-0115-4375-af8d-1d65af37378a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f3dc74-5350-4581-8e73-d361ccc787dd', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084d2b81-893d-4ef0-bb8d-cf2fdb4ee75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c82476c-916e-4add-a6ac-ec1dff32e35a]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:10 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Volume volume-42f3dc74-5350-4581-8e73-d361ccc787dd (42f3dc74-5350-4581-8e73-d361ccc787dd): created successfully Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084d2b81-893d-4ef0-bb8d-cf2fdb4ee75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Flow 'volume_create_manager' (dacdb883-7fb5-4743-aead-7402b8b95890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:10 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-e43f035f-e491-4e76-97bc-877ab8b81cbe tempest-ProjectReaderTests-1968210312 None] Created volume successfully. Sep 15 19:08:10 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 Sep 15 19:08:10 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Acquiring lock "cinder-42f3dc74-5350-4581-8e73-d361ccc787dd-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Lock "cinder-42f3dc74-5350-4581-8e73-d361ccc787dd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Acquiring lock "cinder-quobyte-42f3dc74-5350-4581-8e73-d361ccc787dd" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Lock "cinder-quobyte-42f3dc74-5350-4581-8e73-d361ccc787dd" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbd4ce8-1384-495f-bce3-ecb4008ac653]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:10 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" returned: 0 in 0.379s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:10 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:11 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd Sep 15 19:08:11 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:11 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5 Sep 15 19:08:11 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:11 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" returned: 0 in 0.244s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:11 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd" returned: 0 in 0.370s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-767616fb-e71b-4c3b-aac2-7cc4c3523ab5" released by "delete_volume" :: held 0.722s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:11 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd Sep 15 19:08:11 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Created reservations ['8b014a9a-9917-4ffb-9662-5c0241d82bf9', '741a0212-dc06-4b14-bd84-474c580ff550', 'd1bfd9b3-c999-42f2-a835-3c018287578e', '2954abcd-3ab8-44b1-b6d5-06436d241e84'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:11 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:11 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:11 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-42f3dc74-5350-4581-8e73-d361ccc787dd" returned: 0 in 0.247s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Lock "cinder-quobyte-42f3dc74-5350-4581-8e73-d361ccc787dd" released by "delete_volume" :: held 0.667s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Created reservations ['d1cb47a8-3a50-4e46-8d6d-6070fccdc062', '8ef2cd54-a2e3-436e-8c78-f2233c4b0f80', 'e0ef7e80-9342-44da-b24e-1cae4445215e', 'a87325f8-d4e5-48f3-9d56-1737296f04f1'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:11 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.281s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Deleted volume successfully. Sep 15 19:08:11 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:11 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-58897dd8-85ae-4eab-bb20-2d834543186a tempest-ProjectMemberTests-715700841 None] Lock "cinder-767616fb-e71b-4c3b-aac2-7cc4c3523ab5-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:11 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.260s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:11 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Deleted volume successfully. Sep 15 19:08:11 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b4e43ddd-813f-4b52-b304-12859e8d2ec1 tempest-ProjectReaderTests-1968210312 None] Lock "cinder-42f3dc74-5350-4581-8e73-d361ccc787dd-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (86e647a6-d8bb-4cc1-9713-40037360b1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848af24a-bfe3-44b2-9ad2-887a3cfb86f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848af24a-bfe3-44b2-9ad2-887a3cfb86f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-70163184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c99fbb6-6dec-4edf-85f1-dc66d4844bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:12Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd07543-4409-49c4-b569-f13679c44de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd07543-4409-49c4-b569-f13679c44de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9da05ab-082a-41af-a551-1d95f23f5ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9da05ab-082a-41af-a551-1d95f23f5ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c99fbb6-6dec-4edf-85f1-dc66d4844bb2', 'volume_name': 'volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be31ddd5-d6fd-4bc6-b560-c5abd4a72784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be31ddd5-d6fd-4bc6-b560-c5abd4a72784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac30c4c-6cb8-4fc8-8120-680896624c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:12 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Volume 9c99fbb6-6dec-4edf-85f1-dc66d4844bb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2', 'volume_size': 1} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-70163184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c99fbb6-6dec-4edf-85f1-dc66d4844bb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:12Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Creating volume 9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:12 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:12 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 1073741824 Sep 15 19:08:12 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:12 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 1073741824" returned: 0 in 0.446s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:12 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 Sep 15 19:08:12 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:12 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" returned: 0 in 0.281s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:12 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac30c4c-6cb8-4fc8-8120-680896624c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb33877-b9ad-4a1f-9d45-69d5937171ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:13 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Volume volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 (9c99fbb6-6dec-4edf-85f1-dc66d4844bb2): created successfully Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb33877-b9ad-4a1f-9d45-69d5937171ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (86e647a6-d8bb-4cc1-9713-40037360b1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:13 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-7fee45c6-6b4e-44c8-82ec-534e58075fce tempest-ProjectMemberTests-715700841 None] Created volume successfully. Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Creating offline snapshot 32e2db8a-e4aa-4a8d-929e-9ba509e31d48 of volume 9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d8919-50aa-4478-9c4d-6f2dfc016239]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:13 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 Sep 15 19:08:13 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:13 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" returned: 0 in 0.398s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:13 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:13 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 1G Sep 15 19:08:13 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:14 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 1G" returned: 0 in 0.441s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:14 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 Sep 15 19:08:14 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:14 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48" returned: 0 in 0.294s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:14 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 is being set with open permissions: ugo+rw Sep 15 19:08:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:14 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 Sep 15 19:08:14 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:14 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48" returned: 0 in 0.263s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:14 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:14 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.info Sep 15 19:08:14 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:15 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.info" returned: 0 in 0.277s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:15 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.info is being set with open permissions: ugo+rw Sep 15 19:08:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:15 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.info Sep 15 19:08:15 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:15 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.info" returned: 0 in 0.262s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:15 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:15 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-f8aaafc1-6890-4a00-af61-2fe525ad34b4 tempest-ProjectMemberTests-715700841 None] Create snapshot completed successfully Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-32e2db8a-e4aa-4a8d-929e-9ba509e31d48-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Lock "cinder-32e2db8a-e4aa-4a8d-929e-9ba509e31d48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-32e2db8a-e4aa-4a8d-929e-9ba509e31d48" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-32e2db8a-e4aa-4a8d-929e-9ba509e31d48" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Deleting offline snapshot 32e2db8a-e4aa-4a8d-929e-9ba509e31d48 of volume 9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] snapshot_file for this snap is: volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9d9009-c5ed-4f49-9c73-0e051cc6d6bc]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:16 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 Sep 15 19:08:16 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:16 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48" returned: 0 in 0.386s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:16 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:08:17 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25a98a6-6b32-4b2d-801d-36c013726dfa]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:17 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 Sep 15 19:08:17 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:17 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" returned: 0 in 0.383s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:17 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 Sep 15 19:08:17 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:17 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48" returned: 0 in 0.410s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:17 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:17 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48 Sep 15 19:08:17 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:18 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2.32e2db8a-e4aa-4a8d-929e-9ba509e31d48" returned: 0 in 0.270s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-32e2db8a-e4aa-4a8d-929e-9ba509e31d48" released by "_delete_snapshot" :: held 1.558s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" released by "delete_snapshot" :: held 1.583s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Created reservations ['10b05389-c8b0-429e-a872-61e02bc3ec0c', '1d1cef32-0db6-420b-93cd-34248cbd0a75', '62e6853c-1de6-4071-9747-46013db11d6f', '914c62a2-d34c-4fc9-9e15-44791d7cb544'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:18 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Delete snapshot completed successfully. Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0032419e-c180-4997-bef9-539da009ffab tempest-ProjectMemberTests-715700841 None] Lock "cinder-32e2db8a-e4aa-4a8d-929e-9ba509e31d48-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Lock "cinder-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" acquired by "delete_volume" :: waited 0.027s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ed0f5f-9281-4082-a31f-c41c8c08bcc7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:18 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:19 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 Sep 15 19:08:19 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:19 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" returned: 0 in 0.389s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:19 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2 Sep 15 19:08:19 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:19 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" returned: 0 in 0.250s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2" released by "delete_volume" :: held 0.784s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Created reservations ['974e8039-2e60-4621-90b9-5e59c44691d7', 'd3f9b41a-f450-4d3c-950e-005c91056866', '333fc8e3-c231-4eb0-a98d-3edec37cf959', '13963906-978d-40af-82cf-4e9e811cc246'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:19 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:19 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:19 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:19 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:19 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Deleted volume successfully. Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-9572b6df-7cb1-4651-a64e-661d639ed32d tempest-ProjectMemberTests-715700841 None] Lock "cinder-9c99fbb6-6dec-4edf-85f1-dc66d4844bb2-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (c4d1849f-d139-4683-99a1-5e6642944b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dcc81b4-1d8f-4f74-9f7a-fffb77852fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dcc81b4-1d8f-4f74-9f7a-fffb77852fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998584284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249349dd-5f46-43df-acaa-9ca4b389369b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:20Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99cf0de-3609-41fd-88e2-f54ed79846a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99cf0de-3609-41fd-88e2-f54ed79846a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd935e2-608b-49da-8259-f6555b1b3449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd935e2-608b-49da-8259-f6555b1b3449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249349dd-5f46-43df-acaa-9ca4b389369b', 'volume_name': 'volume-249349dd-5f46-43df-acaa-9ca4b389369b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2978dbab-8497-49b0-ae88-31283c0203d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2978dbab-8497-49b0-ae88-31283c0203d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5131ec5-50a3-4baf-8d4e-1c29c8426f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:20 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Volume 249349dd-5f46-43df-acaa-9ca4b389369b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249349dd-5f46-43df-acaa-9ca4b389369b', 'volume_size': 1} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-998584284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249349dd-5f46-43df-acaa-9ca4b389369b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:20Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Creating volume 249349dd-5f46-43df-acaa-9ca4b389369b {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:20 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:20 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b 1073741824 Sep 15 19:08:20 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:20 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b 1073741824" returned: 0 in 0.505s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:20 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:21 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b Sep 15 19:08:21 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:21 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b" returned: 0 in 0.260s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:21 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:21 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5131ec5-50a3-4baf-8d4e-1c29c8426f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249349dd-5f46-43df-acaa-9ca4b389369b', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1605b8-522b-4ec9-b2b2-318074083728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:21 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Volume volume-249349dd-5f46-43df-acaa-9ca4b389369b (249349dd-5f46-43df-acaa-9ca4b389369b): created successfully Sep 15 19:08:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1605b8-522b-4ec9-b2b2-318074083728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:21 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (c4d1849f-d139-4683-99a1-5e6642944b9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:21 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-df01c030-8827-4467-b571-480fe6d5c5b5 tempest-ProjectMemberTests-715700841 None] Created volume successfully. Sep 15 19:08:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:22 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Creating offline snapshot 8363b448-367a-4115-9b59-f1a16aed47d8 of volume 249349dd-5f46-43df-acaa-9ca4b389369b {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:08:22 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8717f22-9a38-4ee3-bb99-24b58e5b3570]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:22 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:22 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b Sep 15 19:08:22 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:23 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b" returned: 0 in 0.393s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:23 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 1G Sep 15 19:08:23 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:23 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 1G" returned: 0 in 0.424s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-249349dd-5f46-43df-acaa-9ca4b389369b -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:23 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-249349dd-5f46-43df-acaa-9ca4b389369b -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 Sep 15 19:08:23 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:23 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-249349dd-5f46-43df-acaa-9ca4b389369b -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8" returned: 0 in 0.383s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:23 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 is being set with open permissions: ugo+rw Sep 15 19:08:23 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:23 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 Sep 15 19:08:23 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:24 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8" returned: 0 in 0.287s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:24 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.info Sep 15 19:08:24 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:24 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.info" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:24 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.info is being set with open permissions: ugo+rw Sep 15 19:08:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:24 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.info Sep 15 19:08:24 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:24 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.info" returned: 0 in 0.287s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:24 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:24 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-5e190b6b-73ab-4423-8311-4ed72903a0fa tempest-ProjectMemberTests-715700841 None] Create snapshot completed successfully Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-8363b448-367a-4115-9b59-f1a16aed47d8-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Lock "cinder-8363b448-367a-4115-9b59-f1a16aed47d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-249349dd-5f46-43df-acaa-9ca4b389369b" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-249349dd-5f46-43df-acaa-9ca4b389369b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-8363b448-367a-4115-9b59-f1a16aed47d8" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-8363b448-367a-4115-9b59-f1a16aed47d8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Deleting offline snapshot 8363b448-367a-4115-9b59-f1a16aed47d8 of volume 249349dd-5f46-43df-acaa-9ca4b389369b {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] snapshot_file for this snap is: volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4c86c9-e7b0-4785-bd24-742c6aa17b5b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:25 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:26 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 Sep 15 19:08:26 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:26 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8" returned: 0 in 0.390s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:26 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-249349dd-5f46-43df-acaa-9ca4b389369b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:08:26 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d5a62-8aa6-4288-a4d7-1ca0e46fa6c7]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:26 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b Sep 15 19:08:26 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:26 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b" returned: 0 in 0.366s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:26 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:26 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 Sep 15 19:08:26 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:27 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8" returned: 0 in 0.351s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:27 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8 Sep 15 19:08:27 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:27 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:27 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b.8363b448-367a-4115-9b59-f1a16aed47d8" returned: 0 in 0.243s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-8363b448-367a-4115-9b59-f1a16aed47d8" released by "_delete_snapshot" :: held 1.475s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-249349dd-5f46-43df-acaa-9ca4b389369b" released by "delete_snapshot" :: held 1.502s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:27 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:UPDATE=232,cinder:SELECT=163,cinder:DELETE=19,cinder:INSERT=45 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:08:27 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=175,cinder:INSERT=75,cinder:UPDATE=219,cinder:DELETE=20 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:08:27 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Created reservations ['cc7ab85c-fc7e-4a71-bb8e-c2c61c017f1a', 'fa1b3721-c321-467a-9293-885c07f1fb2c', '73c29b47-6674-4048-911b-4560d2cb1e64', '3ea0579e-66db-4fcb-aeb1-f59789dbb684'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:27 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Delete snapshot completed successfully. Sep 15 19:08:27 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0d3715f4-4549-4f74-8a3e-e8187ed8365e tempest-ProjectMemberTests-715700841 None] Lock "cinder-8363b448-367a-4115-9b59-f1a16aed47d8-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-249349dd-5f46-43df-acaa-9ca4b389369b-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Lock "cinder-249349dd-5f46-43df-acaa-9ca4b389369b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-249349dd-5f46-43df-acaa-9ca4b389369b" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-249349dd-5f46-43df-acaa-9ca4b389369b" acquired by "delete_volume" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cbc4dc-10e6-4b68-94dd-e80aa2f2e501]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:28 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b Sep 15 19:08:28 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:28 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b" returned: 0 in 0.385s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:28 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b Sep 15 19:08:28 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:28 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-249349dd-5f46-43df-acaa-9ca4b389369b" returned: 0 in 0.245s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-249349dd-5f46-43df-acaa-9ca4b389369b" released by "delete_volume" :: held 0.722s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Created reservations ['91338fcf-1269-4da8-b48f-ca9797c5a973', '392817bb-d5bd-4474-996b-5436c2ff64e5', '8ca903d7-437c-4705-8a80-1f21dba2eebe', 'edfdec3b-62f4-4202-8829-9df39b8ee290'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:28 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:28 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:28 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:29 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.259s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:29 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Deleted volume successfully. Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1914faaf-9e8f-4904-90f1-24aa02ecc44f tempest-ProjectMemberTests-715700841 None] Lock "cinder-249349dd-5f46-43df-acaa-9ca4b389369b-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (313f27e2-e66c-46ea-911c-1bdd3b2aad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f47896-f6c8-4ad5-9912-9730759c1a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f47896-f6c8-4ad5-9912-9730759c1a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114837238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:30Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9b6182-b041-4aa2-962e-9f590dee9220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9b6182-b041-4aa2-962e-9f590dee9220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0f693e-4a15-48eb-b77b-a8f0a3f37b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0f693e-4a15-48eb-b77b-a8f0a3f37b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c', 'volume_name': 'volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee05ef41-aea5-432c-bbbd-747367519c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee05ef41-aea5-432c-bbbd-747367519c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08ada93-5f69-48ff-b2cd-624cb5f140b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:29 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Volume ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c', 'volume_size': 1} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114837238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e07369d2e0c437b80bd43e31d890018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:30Z,use_quota=True,user_id='d73daa6ed17449469dc30500d0471af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Creating volume ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:29 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:29 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:29 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c 1073741824 Sep 15 19:08:29 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:30 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c 1073741824" returned: 0 in 0.488s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:30 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c Sep 15 19:08:30 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:30 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" returned: 0 in 0.255s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:30 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:30 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b08ada93-5f69-48ff-b2cd-624cb5f140b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acba499e-fcc0-499d-8e18-2368263490c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:30 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Volume volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c (ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c): created successfully Sep 15 19:08:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acba499e-fcc0-499d-8e18-2368263490c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:30 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Flow 'volume_create_manager' (313f27e2-e66c-46ea-911c-1bdd3b2aad01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:30 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-c1fa1612-95b2-4f61-80b1-28d4da5639e5 tempest-ProjectMemberTests-715700841 None] Created volume successfully. Sep 15 19:08:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:32 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Creating offline snapshot 1db53097-9f0e-4b3c-9e9b-f322859da173 of volume ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:08:32 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[24beff21-d55d-4653-9f64-a11abd472604]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:32 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c Sep 15 19:08:32 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:32 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" returned: 0 in 0.396s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:32 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:32 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 1G Sep 15 19:08:32 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:32 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 1G" returned: 0 in 0.472s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:33 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 Sep 15 19:08:33 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:33 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173" returned: 0 in 0.305s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:33 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 is being set with open permissions: ugo+rw Sep 15 19:08:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:33 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 Sep 15 19:08:33 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:33 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173" returned: 0 in 0.244s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:33 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.info Sep 15 19:08:33 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:33 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.info" returned: 0 in 0.272s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:33 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.info is being set with open permissions: ugo+rw Sep 15 19:08:33 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:33 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.info Sep 15 19:08:33 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:34 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.info" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:34 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:34 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-cacd3026-e2aa-4e18-b9f8-43d51928e2b4 tempest-ProjectMemberTests-715700841 None] Create snapshot completed successfully Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-1db53097-9f0e-4b3c-9e9b-f322859da173-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Lock "cinder-1db53097-9f0e-4b3c-9e9b-f322859da173-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-1db53097-9f0e-4b3c-9e9b-f322859da173" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-1db53097-9f0e-4b3c-9e9b-f322859da173" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Deleting offline snapshot 1db53097-9f0e-4b3c-9e9b-f322859da173 of volume ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] snapshot_file for this snap is: volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[7541e8c9-9b55-4fa2-87a4-1a743367bdff]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:35 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 Sep 15 19:08:35 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:35 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173" returned: 0 in 0.426s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f5eb1b-5175-4724-8332-029f7ac10d12]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:35 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:36 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c Sep 15 19:08:36 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:36 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" returned: 0 in 0.393s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:36 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 Sep 15 19:08:36 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Flow 'volume_create_manager' (8ba08310-6c86-4e24-a243-171fcd4347ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8a143c-ea7c-441a-8694-fff979bc5848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8a143c-ea7c-441a-8694-fff979bc5848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-373287139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1671d3-cae8-4e76-81a9-a1ff294287f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce878187ddb4ab98a28c5c3e2c4448d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:36Z,use_quota=True,user_id='36cafa6b006a4993a8c56f60339010f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30454d02-ef1f-4aad-b124-41491979c622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30454d02-ef1f-4aad-b124-41491979c622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811989c2-b451-432b-b0ef-2b7163a93ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811989c2-b451-432b-b0ef-2b7163a93ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1671d3-cae8-4e76-81a9-a1ff294287f9', 'volume_name': 'volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51990976-ffbf-4dfa-bdf9-250e1fbd0eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51990976-ffbf-4dfa-bdf9-250e1fbd0eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4fac61-ed82-4999-9cf2-023f8d2db618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:36 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Volume 3f1671d3-cae8-4e76-81a9-a1ff294287f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9', 'volume_size': 1} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-373287139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1671d3-cae8-4e76-81a9-a1ff294287f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce878187ddb4ab98a28c5c3e2c4448d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:36Z,use_quota=True,user_id='36cafa6b006a4993a8c56f60339010f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Creating volume 3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:36 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:36 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 1073741824 Sep 15 19:08:36 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:36 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173" returned: 0 in 0.356s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:36 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173 Sep 15 19:08:36 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:36 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:36 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c.1db53097-9f0e-4b3c-9e9b-f322859da173" returned: 0 in 0.271s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:36 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 1073741824" returned: 0 in 0.475s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-1db53097-9f0e-4b3c-9e9b-f322859da173" released by "_delete_snapshot" :: held 1.574s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" released by "delete_snapshot" :: held 1.606s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:37 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 Sep 15 19:08:37 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Created reservations ['2e0538cd-f0e4-4db1-8643-11ed272a5675', '9dd03429-1ce9-4404-bea6-25e40180cca7', '0e98afd0-ff08-4278-8569-034829c39bcd', '14b81613-d6f9-40bb-adb5-e7e2a39c8cd7'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Delete snapshot completed successfully. Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-375e7316-b13b-4c07-94aa-9d2860259e58 tempest-ProjectMemberTests-715700841 None] Lock "cinder-1db53097-9f0e-4b3c-9e9b-f322859da173-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:37 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9" returned: 0 in 0.258s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4fac61-ed82-4999-9cf2-023f8d2db618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c899c5b0-676a-49f1-ba85-cbf0449f368e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:37 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Volume volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 (3f1671d3-cae8-4e76-81a9-a1ff294287f9): created successfully Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c899c5b0-676a-49f1-ba85-cbf0449f368e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Flow 'volume_create_manager' (8ba08310-6c86-4e24-a243-171fcd4347ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:37 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-fb68b6b0-3202-455f-ac43-928ea9b7eddd tempest-SnapshotDependencyTests-1601954085 None] Created volume successfully. Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Lock "cinder-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Acquiring lock "cinder-quobyte-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" acquired by "delete_volume" :: waited 0.014s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e00cd05-02d3-4a4a-8717-9e5584e9584b]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:37 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:37 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c Sep 15 19:08:37 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:38 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" returned: 0 in 0.361s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:38 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c Sep 15 19:08:38 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:38 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" returned: 0 in 0.240s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Lock "cinder-quobyte-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c" released by "delete_volume" :: held 0.658s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Created reservations ['fb99a415-4ea2-40ba-8d8c-c451597d0142', '1fcdda4c-0be6-41fa-bad4-fac734f163c8', '66261889-cf54-4a29-894e-6960cf634ad7', '621c3f41-4564-4306-8f9b-dd163715b9bb'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:38 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:38 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:38 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.247s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:38 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Deleted volume successfully. Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-a446f784-e8ed-4967-b151-35a9b830fd76 tempest-ProjectMemberTests-715700841 None] Lock "cinder-ee4539a6-1ace-4e8a-8dbf-f3d52eceb37c-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Creating offline snapshot 423ffc12-c1a7-4f78-b714-9e2de53e1cb9 of volume 3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a30bc3-f80f-4933-abdc-6355a0773e5c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:38 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:38 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 Sep 15 19:08:38 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:39 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9" returned: 0 in 0.379s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 1G {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:39 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 1G Sep 15 19:08:39 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:39 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 1G" returned: 0 in 0.438s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:39 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 Sep 15 19:08:39 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:39 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 -F qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9" returned: 0 in 0.317s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:39 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 is being set with open permissions: ugo+rw Sep 15 19:08:39 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:39 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 Sep 15 19:08:39 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:40 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9" returned: 0 in 0.274s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:40 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.info Sep 15 19:08:40 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:40 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.info" returned: 0 in 0.266s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:40 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.info is being set with open permissions: ugo+rw Sep 15 19:08:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.info {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:40 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.info Sep 15 19:08:40 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:40 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.info" returned: 0 in 0.260s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:40 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:40 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-46a1c910-7061-4bfe-ac9e-c5bc3df98eba tempest-SnapshotDependencyTests-1601954085 None] Create snapshot completed successfully Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Flow 'volume_create_manager' (2a07e6bb-2936-473f-8eb8-563b976dd761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e9238f-3b89-41e4-bd6a-9224487de644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e9238f-3b89-41e4-bd6a-9224487de644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877128002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467cd0d9-6ee2-4d80-afdc-eda5c109812e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1944b975d274ad6b830b1e2a02fdef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:42Z,use_quota=True,user_id='02acf442e1554c29932f3426b1e46823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fce4481-5460-4796-aa66-4244dec4f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fce4481-5460-4796-aa66-4244dec4f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f36e5e7-440f-4719-aec3-e89f56016dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f36e5e7-440f-4719-aec3-e89f56016dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '467cd0d9-6ee2-4d80-afdc-eda5c109812e', 'volume_name': 'volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930ea5a3-30d6-4cfb-bd91-ce9e523f4e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930ea5a3-30d6-4cfb-bd91-ce9e523f4e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa195c9-73bb-4150-90b7-41039061e066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Volume 467cd0d9-6ee2-4d80-afdc-eda5c109812e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e', 'volume_size': 1} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877128002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=467cd0d9-6ee2-4d80-afdc-eda5c109812e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1944b975d274ad6b830b1e2a02fdef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:42Z,use_quota=True,user_id='02acf442e1554c29932f3426b1e46823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Creating volume 467cd0d9-6ee2-4d80-afdc-eda5c109812e {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:42 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:42 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e 1073741824 Sep 15 19:08:42 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Flow 'volume_create_manager' (5eff7a52-d15e-4cdc-9f98-0927f6360252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba5d186-efa7-4334-8188-6b30d7ad8759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba5d186-efa7-4334-8188-6b30d7ad8759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e512d9-2cc8-4661-b0cc-ab1f72356f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ce878187ddb4ab98a28c5c3e2c4448d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=423ffc12-c1a7-4f78-b714-9e2de53e1cb9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:43Z,use_quota=True,user_id='36cafa6b006a4993a8c56f60339010f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ebd211-3e7a-4ffa-9d81-15bb33979c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ebd211-3e7a-4ffa-9d81-15bb33979c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0030cab-75c2-4c97-8a31-ec984cf7df70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0030cab-75c2-4c97-8a31-ec984cf7df70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b7e512d9-2cc8-4661-b0cc-ab1f72356f54', 'volume_name': 'volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54', 'volume_size': 1, 'snapshot_id': '423ffc12-c1a7-4f78-b714-9e2de53e1cb9'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc70f4e-103d-46b7-9698-2dcd0a3d5b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc70f4e-103d-46b7-9698-2dcd0a3d5b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2387b2-0a49-452f-972b-665212b1c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:42 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Volume b7e512d9-2cc8-4661-b0cc-ab1f72356f54: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54', 'volume_size': 1, 'snapshot_id': '423ffc12-c1a7-4f78-b714-9e2de53e1cb9'} Sep 15 19:08:42 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:43 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e 1073741824" returned: 0 in 0.427s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:43 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e Sep 15 19:08:43 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:43 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e" returned: 0 in 0.263s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.591s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "cinder-quobyte-423ffc12-c1a7-4f78-b714-9e2de53e1cb9-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" by "_create_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa195c9-73bb-4150-90b7-41039061e066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9674945c-75b0-4bab-82ed-b83c2c294ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-423ffc12-c1a7-4f78-b714-9e2de53e1cb9-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Creating volume b7e512d9-2cc8-4661-b0cc-ab1f72356f54 from snapshot 423ffc12-c1a7-4f78-b714-9e2de53e1cb9 {{(pid=86137) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "cinder-quobyte-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" by "_copy_volume_from_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] snapshot: 423ffc12-c1a7-4f78-b714-9e2de53e1cb9, volume: b7e512d9-2cc8-4661-b0cc-ab1f72356f54, {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 19:08:43 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Volume volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e (467cd0d9-6ee2-4d80-afdc-eda5c109812e): created successfully Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9674945c-75b0-4bab-82ed-b83c2c294ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Flow 'volume_create_manager' (2a07e6bb-2936-473f-8eb8-563b976dd761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:43 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-04640b47-5e5e-4f02-b180-dbea2492b941 tempest-ProjectReaderTests-505241781 None] Created volume successfully. Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8a3cf1-23d9-4ae1-b0b4-c093e868cefa]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:43 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 Sep 15 19:08:43 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:43 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9" returned: 0 in 0.366s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d4d77-5129-4e7c-be9f-c8e1d93d8faf]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:43 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:44 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 Sep 15 19:08:44 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:44 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9" returned: 0 in 0.364s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Creating direct copy from snapshot {{(pid=86137) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG cinder.utils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Path /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 not found in is_blk_device check {{(pid=86137) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:44 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 Sep 15 19:08:44 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Acquiring lock "cinder-467cd0d9-6ee2-4d80-afdc-eda5c109812e-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Lock "cinder-467cd0d9-6ee2-4d80-afdc-eda5c109812e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Acquiring lock "cinder-quobyte-467cd0d9-6ee2-4d80-afdc-eda5c109812e" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Lock "cinder-quobyte-467cd0d9-6ee2-4d80-afdc-eda5c109812e" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9e5ae3-cf4a-4523-9d81-d91776f3ede0]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:44 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:44 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e Sep 15 19:08:44 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:45 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e" returned: 0 in 0.663s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:45 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e Sep 15 19:08:45 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:45 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-467cd0d9-6ee2-4d80-afdc-eda5c109812e" returned: 0 in 0.376s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Lock "cinder-quobyte-467cd0d9-6ee2-4d80-afdc-eda5c109812e" released by "delete_volume" :: held 1.119s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:45 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:45 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:45 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Created reservations ['6b0fdcf0-ca47-4103-955a-191b22c0e098', '38326098-6012-4ca0-90fc-099569718c8f', 'a8c06205-80e4-45c8-89f4-64eb6704a381', 'd810c059-69b0-4302-861a-092f75b027f1'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:46 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:46 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:46 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.486s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG oslo_service.periodic_task [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] Running periodic task VolumeManager._thread_info {{(pid=86137) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread count: 29 {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-9f63a47f-4843-479b-8c56-66c53aa714b8 None None] thread info: [<_MainThread(MainThread, started 140270453526656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86137) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 19:08:46 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.436s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:46 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Deleted volume successfully. Sep 15 19:08:46 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-6c6d8b80-1517-4928-bfb4-2e9a32277553 tempest-ProjectReaderTests-505241781 None] Lock "cinder-467cd0d9-6ee2-4d80-afdc-eda5c109812e-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86137) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Flow 'volume_create_manager' (4a1bc434-0a85-4eb1-9968-5181455716b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fecb3c-27a1-40b8-bc1d-950a17a70e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20fecb3c-27a1-40b8-bc1d-950a17a70e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1821483031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a71b71a-cd55-41c7-ac6a-1928af08dbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1944b975d274ad6b830b1e2a02fdef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:48Z,use_quota=True,user_id='02acf442e1554c29932f3426b1e46823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e859ef9f-6d36-4beb-b741-5a68a10e1564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e859ef9f-6d36-4beb-b741-5a68a10e1564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c810ccd-3538-4f2c-91a0-f4cccf3f55fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c810ccd-3538-4f2c-91a0-f4cccf3f55fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a71b71a-cd55-41c7-ac6a-1928af08dbb8', 'volume_name': 'volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4f1ad5-7887-470f-b254-276487f6c1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4f1ad5-7887-470f-b254-276487f6c1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac460ad-8bc3-4097-8ab3-f70294f04c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:47 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Volume 1a71b71a-cd55-41c7-ac6a-1928af08dbb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8', 'volume_size': 1} Sep 15 19:08:47 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:51 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" returned: 0 in 6.792s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.image.image_utils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Image conversion details: src /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 {{(pid=86137) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 15 19:08:51 devstack cinder-volume[86137]: INFO cinder.image.image_utils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Converted 1024.00 MB image at 150.75 MB/s Sep 15 19:08:51 devstack cinder-volume[86137]: WARNING cinder.volume.drivers.remotefs [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 is being set with open permissions: ugo+rw Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:51 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 Sep 15 19:08:51 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:51 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" returned: 0 in 0.241s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" released by "_copy_volume_from_snapshot" :: held 7.870s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-423ffc12-c1a7-4f78-b714-9e2de53e1cb9-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" released by "_create_volume_from_snapshot" :: held 7.937s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.967s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.534s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T17:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1821483031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a71b71a-cd55-41c7-ac6a-1928af08dbb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1944b975d274ad6b830b1e2a02fdef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T17:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T17:08:48Z,use_quota=True,user_id='02acf442e1554c29932f3426b1e46823',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c97d02fb-5362-4cce-b433-19633cfa9c95),volume_type_id=c97d02fb-5362-4cce-b433-19633cfa9c95)}" {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Creating volume 1a71b71a-cd55-41c7-ac6a-1928af08dbb8 {{(pid=86137) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Selected osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b as target Quobyte volume. {{(pid=86137) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 19:08:51 devstack cinder-volume[86137]: INFO cinder.volume.drivers.remotefs [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] casted to osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 1073741824 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:51 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 1073741824 Sep 15 19:08:51 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba2387b2-0a49-452f-972b-665212b1c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54', 'volume_size': 1, 'snapshot_id': '423ffc12-c1a7-4f78-b714-9e2de53e1cb9'}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4ddf06-01a8-4db6-bf6c-177063a3c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:51 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Volume volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 (b7e512d9-2cc8-4661-b0cc-ab1f72356f54): created successfully Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4ddf06-01a8-4db6-bf6c-177063a3c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Flow 'volume_create_manager' (5eff7a52-d15e-4cdc-9f98-0927f6360252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:51 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-4da48b57-e61b-4cc2-b510-0367f5b11299 tempest-SnapshotDependencyTests-1601954085 None] Created volume successfully. Sep 15 19:08:51 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 1073741824" returned: 0 in 0.412s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:51 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:51 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 Sep 15 19:08:51 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:52 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8" returned: 0 in 0.240s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'} {{(pid=86137) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac460ad-8bc3-4097-8ab3-f70294f04c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8', 'volume_size': 1}' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea180966-8049-4400-b6ba-3a5bfabbdf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 19:08:52 devstack cinder-volume[86137]: INFO cinder.volume.flows.manager.create_volume [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Volume volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 (1a71b71a-cd55-41c7-ac6a-1928af08dbb8): created successfully Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea180966-8049-4400-b6ba-3a5bfabbdf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86137) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Flow 'volume_create_manager' (4a1bc434-0a85-4eb1-9968-5181455716b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86137) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 19:08:52 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-8df817e9-3c2d-4643-9208-d53ad4622ccd tempest-ProjectReaderTests-505241781 None] Created volume successfully. Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "cinder-423ffc12-c1a7-4f78-b714-9e2de53e1cb9-delete_snapshot" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-423ffc12-c1a7-4f78-b714-9e2de53e1cb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "cinder-quobyte-3f1671d3-cae8-4e76-81a9-a1ff294287f9" by "delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-3f1671d3-cae8-4e76-81a9-a1ff294287f9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "cinder-quobyte-423ffc12-c1a7-4f78-b714-9e2de53e1cb9" by "_delete_snapshot" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-423ffc12-c1a7-4f78-b714-9e2de53e1cb9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Deleting offline snapshot 423ffc12-c1a7-4f78-b714-9e2de53e1cb9 of volume 3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] snapshot_file for this snap is: volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 {{(pid=86137) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ca6881-8d21-40f3-a8b0-66833f5f5f55]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:52 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 Sep 15 19:08:52 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:52 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9" returned: 0 in 0.359s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.remotefs [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86137) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bf1274-136c-422f-8a68-1b904a8f3e0f]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:52 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 Sep 15 19:08:52 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:52 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Acquiring lock "cinder-1a71b71a-cd55-41c7-ac6a-1928af08dbb8-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Lock "cinder-1a71b71a-cd55-41c7-ac6a-1928af08dbb8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Acquiring lock "cinder-quobyte-1a71b71a-cd55-41c7-ac6a-1928af08dbb8" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Lock "cinder-quobyte-1a71b71a-cd55-41c7-ac6a-1928af08dbb8" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf35528b-f1a6-4dca-abd4-d3a098aa115d]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:53 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 Sep 15 19:08:53 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:53 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9" returned: 0 in 0.567s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:53 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 Sep 15 19:08:53 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:53 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8" returned: 0 in 0.364s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:53 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8 Sep 15 19:08:53 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:53 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9" returned: 0 in 0.342s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:53 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9 Sep 15 19:08:53 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:53 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-1a71b71a-cd55-41c7-ac6a-1928af08dbb8" returned: 0 in 0.257s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Lock "cinder-quobyte-1a71b71a-cd55-41c7-ac6a-1928af08dbb8" released by "delete_volume" :: held 0.664s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Created reservations ['7effd33a-67c6-4f89-a21c-c7749edbc4e8', 'c77c85ee-2b56-4253-8bbf-2257b7388f1b', '1c7b014d-85f7-4539-89e2-d91cf0b32834', 'f04be524-1e77-49d0-ac16-f73bcbc96820'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:53 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:53 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:53 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9.423ffc12-c1a7-4f78-b714-9e2de53e1cb9" returned: 0 in 0.259s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-423ffc12-c1a7-4f78-b714-9e2de53e1cb9" released by "_delete_snapshot" :: held 1.638s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:53 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-3f1671d3-cae8-4e76-81a9-a1ff294287f9" released by "delete_snapshot" :: held 1.661s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Created reservations ['c0862aea-f00f-4013-8453-4ad3a1b0c1a3', '8b6345f0-5823-4383-8939-4c421d12e65a', '7539b597-23f0-4533-a07c-20358da58a9d', '483a2945-a070-4dd9-84ca-87352b27522d'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Delete snapshot completed successfully. Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-b043b6c8-d3a6-43d6-b825-e5fa1659b6e2 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-423ffc12-c1a7-4f78-b714-9e2de53e1cb9-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:54 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.285s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:54 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Deleted volume successfully. Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-0b50abb4-b14a-49c6-b204-aba6741e7e14 tempest-ProjectReaderTests-505241781 None] Lock "cinder-1a71b71a-cd55-41c7-ac6a-1928af08dbb8-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "cinder-3f1671d3-cae8-4e76-81a9-a1ff294287f9-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-3f1671d3-cae8-4e76-81a9-a1ff294287f9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "cinder-quobyte-3f1671d3-cae8-4e76-81a9-a1ff294287f9" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-3f1671d3-cae8-4e76-81a9-a1ff294287f9" acquired by "delete_volume" :: waited 0.021s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82de4a0-5440-48d1-a754-8afb2944946c]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:54 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 Sep 15 19:08:54 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:54 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9" returned: 0 in 0.381s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:54 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:54 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9 Sep 15 19:08:54 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:55 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-3f1671d3-cae8-4e76-81a9-a1ff294287f9" returned: 0 in 0.274s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-3f1671d3-cae8-4e76-81a9-a1ff294287f9" released by "delete_volume" :: held 0.725s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Created reservations ['4d3e590f-3094-4fda-9814-b15896cc5e1e', 'c264ceeb-53b2-43df-82a9-1eab80007659', '566ec63e-bec0-4e4f-86a2-3e4abef66a4e', '9a8e0720-c6d6-4b88-a2f7-8f957ebbb6fa'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:55 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:55 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:55 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.260s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "cinder-b7e512d9-2cc8-4661-b0cc-ab1f72356f54-delete_volume" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:55 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Deleted volume successfully. Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-b7e512d9-2cc8-4661-b0cc-ab1f72356f54-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-1c578221-3c64-4620-84aa-030ca76ac1b1 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-3f1671d3-cae8-4e76-81a9-a1ff294287f9-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "cinder-quobyte-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" by "delete_volume" {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" acquired by "delete_volume" :: waited 0.016s {{(pid=86137) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda80028-0f68-4d61-ab2e-6b6997ebf7c9]: (4, 'qcow2') {{(pid=87425) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 19:08:55 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:55 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 Sep 15 19:08:55 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:56 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" returned: 0 in 0.398s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:56 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54 Sep 15 19:08:56 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:56 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366/volume-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" returned: 0 in 0.265s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-quobyte-b7e512d9-2cc8-4661-b0cc-ab1f72356f54" released by "delete_volume" :: held 0.712s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG cinder.quota [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Created reservations ['11874a72-8421-4bd3-b5a9-59741591c8f8', 'e46bbc0e-30ea-40da-8636-f4b7ad22b8fd', 'f2f1655a-f25e-4dc3-b5b8-d3c37655486f', 'f2a50ce1-5d4f-4b78-a8ac-6fd8768907f8'] {{(pid=86137) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b': None} {{(pid=86137) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG cinder.volume.drivers.quobyte [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-383622f5-f0ab-4a5d-a01b-20af5057b65b'] {{(pid=86137) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.lockutils [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86137) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 19:08:56 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366 Sep 15 19:08:56 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 19:08:56 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG oslo_concurrency.processutils [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6495a3885c3381d753e77991bd20d366" returned: 0 in 0.252s {{(pid=86137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG cinder.manager [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Notifying Schedulers of capabilities ... {{(pid=86137) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 19:08:56 devstack cinder-volume[86137]: INFO cinder.volume.manager [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Deleted volume successfully. Sep 15 19:08:56 devstack cinder-volume[86137]: DEBUG cinder.coordination [None req-3077d880-ca96-41ef-8f31-2cacef0a5629 tempest-SnapshotDependencyTests-1601954085 None] Lock "cinder-b7e512d9-2cc8-4661-b0cc-ab1f72356f54-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86137) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 19:09:06 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:SELECT=67,cinder:INSERT=25,cinder:UPDATE=81,cinder:DELETE=7 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 19:09:06 devstack cinder-volume[86137]: DEBUG dbcounter [-] [86137] Writing DB stats cinder:INSERT=18,cinder:UPDATE=84,cinder:SELECT=55,cinder:DELETE=6 {{(pid=86137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}